Google Dataproc Hive Connection throwing error

[ARajchandani]

Hi Team,

Whenever I try to connect to Hive which is on Google Dataproc distribution, I get the following error:

com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found

{

 "code" : 404,

 "errors" : [ {

  "domain" : "global",

  "message" : "Not found: Job projects/google-project-id/regions/global/jobs/mylocaltalendproject_W0ZfZr_0def4525-70cf-4355-96c3-2f5adcc2f77e_1",

  "reason" : "notFound"

 } ],

 "message" : "Not found: Job

projects/google-project-id/regions/global/jobs/mylocaltalendproject

_W0ZfZr_0def4525-70cf-4355-96c3-2f5adcc2f77e_1",

 "status" : "NOT_FOUND"

}

[Anonymous]

Hello,

This normally means that the server received the request but could not find resource requested or that it doesn't exist.

What's Distributions Dataproc are you using?

Are you using Hive connection component and the option google credentials in a file? Screenshots of your connection setting will be preferred.

Best regards

Sabrina

[ARajchandani]

Hi Sabrina, I have tried using tHiveConnection as well as the connection in tHiveInput as well but to no avail,

This is my flow

I am just trying to read some records from a table in Hive, tLibraryLoad is used to load the log4j library.

Here is the configuration for tHiveInput:

I can verify that the table and database name that I am giving exist in hive and even without providing the secret and access key, the j3 jar is getting transferred to the specified bucket.

Please let me know what I am doing wrong.

[ARajchandani]

Also, I am using VM, for example "dataproc-m" name of my master dataproc node as the Cluster Identifier, am I doing this correct? Can really uses some help here

[Anonymous]

Hello,

From your screenshots, you are using the option google credentials in a file.

Are you able to connect to and submit the queries using tHiverow? Could you please clarify in which Talend version/edition you are?

Best regards

Sabrina

[ARajchandani]

tHiveRow is giving me the same error, I am using Talend Open Studio for Big Data (7.3.1)