Skip to main content
Announcements
A fresh, new look for the Data Integration & Quality forums and navigation! Read more about what's changed.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Unable to execute the Hive SQL query in hive via talend open studio for data quality from Analysis (profiling).

Hi All

 

Am able to connect Hive database and unable to execute the Hive sql query for the analysis.

 

jdbc:hive2://<Ip Address>:10000/Database;tez.queue.name=QueueName;hive.execution.engine=tez;use.hive.interactive.mode=true;

Updated the Login, Password in the connection

Created the New Column Analysis

Configured the simple Statistics Rules

Execute the analysis and found that below error message.

 

eclipse.buildId=unknown
java.version=1.8.0_161
java.vendor=Oracle Corporation
BootLoader constants: OS=win32, ARCH=x86_64, WS=win32, NL=en_US
Command-line arguments: -os win32 -ws win32 -arch x86_64

This is a continuation of log file <Talend Path>\workspace\.metadata\.bak_0.log
Created Time: 2018-09-04 10:57:25.409

org.talend.platform.logging
Error
Wed Sep 05 04:56:19 EDT 2018
2018-09-05 04:56:19,450 ERROR org.talend.dq.analysis.ColumnAnalysisSqlParallelExecutor - java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

 

java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:336)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:239)
at org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(ColumnAnalysisSqlExecutor.java:1481)
at org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(ColumnAnalysisSqlExecutor.java:1431)
at org.talend.dq.analysis.ColumnAnalysisSqlParallelExecutor.run(ColumnAnalysisSqlParallelExecutor.java:112)
at org.talend.dq.analysis.ColumnAnalysisSqlExecutor$ExecutiveAnalysisJob.run(ColumnAnalysisSqlExecutor.java:1234)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)

 

Could you please help me on this

 

Thanks

Rakesh

Labels (2)
3 Replies
Anonymous
Not applicable
Author

Hello,

Are you performing an Table or Column analyis on a hive table? On which talend open studio for data quality build version you got this issue?

Could you please give us some detailed steps to reproduce your issue?

Best regards

Sabrina

 

Anonymous
Not applicable
Author

Any update on this as I have a prospect that is encountering the same issue and is using the Talend Platform?

Anonymous
Not applicable
Author

am able to reproduce this issue in Column Analysis in Talend Open Studio for Data Quality 7.0.1.

Steps to Reproduce:

 

jdbc:hive2://<Ip Address>:10000/Database;tez.queue.name=QueueName;hive.execution.engine=tez;use.hive.interactive.mode=true;

Updated the Login, Password in the connection and Hive Connection is successful.

 

Created the New Column Analysis

Configured the simple Statistics Rules

Execute the analysis and found that above error message.

 

 

Thanks

Rakesh