topic Re: Where clause causes error in tHiveInput component in Talend Studio

Where clause causes error in tHiveInput component

Anonymous — Sat, 16 Nov 2024 06:43:15 GMT

Hi,

I am getting error while using any condition/aggregation in SQL query in tHiveInput component. It is perfectly working when we use query without having any condition.

Is there any parameter or setup required from Talend specific or Hive specific . Please let me know.

Talend: Talend Open studio for Big Data v7.0.1

Hive: Cloudera CDH5.10

Working query:

"SELECT
productCatalogDesc

FROM ProductCatalog limit 10 "

Not Working queries:

"SELECT
productCatalogDesc

FROM ProductCatalog where productCatalogDesc is not null limit 10 "

"SELECT
count(1)

FROM ProductCatalog "

Exception in component tHiveInput_3 (adh_connection_test)
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:284)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:380)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveInput_3Process(adh_connection_test.java:1902)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveInput_1Process(adh_connection_test.java:1478)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveConnection_2Process(adh_connection_test.java:815)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveConnection_1Process(adh_connection_test.java:570)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.runJobInTOS(adh_connection_test.java:2344)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.main(adh_connection_test.java:2193)
[statistics] disconnected

Re: Where clause causes error in tHiveInput component

akumar2301 — Wed, 30 Jan 2019 14:49:21 GMT

Can this help?

https://community.hortonworks.com/questions/47818/hive-query-failed-over-jdbc.html

Re: Where clause causes error in tHiveInput component

Anonymous — Thu, 31 Jan 2019 05:29:49 GMT

Hi @uganesh ,

Error showing from the URL and my error has slight difference, anyway I used the same config as jdbc parameter, still no luck yet.

My error: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Error from URL: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

Re: Where clause causes error in tHiveInput component

Anonymous — Thu, 31 Jan 2019 07:52:30 GMT

Hello,

Could you please run the same query on the Hive Query Editor successfully?

Best regards

Sabrina

Re: Where clause causes error in tHiveInput component

Anonymous — Thu, 31 Jan 2019 09:40:43 GMT

Hi @xdshi ,

I am connecting hive remotely and don't have Hue Terminal access to run the query. Is there any way to run this query (apart from Talend and Hue terminal) in windows?

Re: Where clause causes error in tHiveInput component

Anonymous — Fri, 01 Feb 2019 14:14:51 GMT

Hi All,

The issue got resolved and it was due to the permission for hadoop user. Actually the user which I am using didn't have permission for conditional/join query, so hadoop admin team resolved this issue.

@xdshi @uganesh Thanks for your time to respond my query.

Regards,

Vibin CT.