Talend Spark Job issue with Hive

[msdawood]

Hi Team,

I'm using Talend Data Fabric 7.1.2 and I'm trying to read Avro file in HDFS and load into Hive table, I'm getting below error (Attached detailed Error)

Caused by: java.lang.ClassNotFoundException: org.apache.tez.dag.api.SessionNotRunning

Thanks,

Mohammed

[Anonymous]

Hi,

    Could you please double check whether you have installed all the dependent jar files for the Hive and HDFS components? Usually Studio will prompt you to install them.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[msdawood]

Yes, we have crossed checked ,all the depended jars are installed...

[Anonymous]

Hi,

   Could you please advise which jar you are trying to load using tLibraryLoad component? If all modules are loaded, I believe you do not need the tLibraryLoad component in your job.

   In worst case, if you are trying to load the libraries manually, could you please check whether you have added import command in the advance section of tLibraryLoad? Lets also check opinion of @rhall  and @xdshi 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[Anonymous]

Hello,

From error message, it seems that there is configuration problem for the Tez jars. Could you please precise your environment? What's hadoop version are you using? Are you using Tez as engine for Hive instead of MR?

Best regards

Sabrina

[msdawood]

Yes @xdshi We are using Tez as engine for Hive

We are using EMR 5.15.0(Hadoop 2.8.3) 

@nthampi  We are importing jersey-client-1.9.jar