Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Bucharest on Sept 18th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Calling Hadoop Java code in MapReduce Job

HI Team,

 

I have a custom java code which was written using MapReduce libraries. I was able to run the jar file successfully on Hadoop cluster. But, while I am running the same jar in "Big Data Batch Job" with tLibraryLoad, I am getting Error like, could not be able to load main class.Could any one help me, what am I missing.

 

Note: command to run the Jar in cluster

hadoop jar <jarName> <className> <arg1> <arg2>

 

Run  Arguments in Talend Job:

<className>

<arg1>

<arg2>

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Are you using tJava or tJavaRow components to write custom java code in your spark batch job?

Best regards

Sabrina