Skip to main content
Announcements
A fresh, new look for the Data Integration & Quality forums and navigation! Read more about what's changed.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Calling Hadoop Java code in MapReduce Job

HI Team,

 

I have a custom java code which was written using MapReduce libraries. I was able to run the jar file successfully on Hadoop cluster. But, while I am running the same jar in "Big Data Batch Job" with tLibraryLoad, I am getting Error like, could not be able to load main class.Could any one help me, what am I missing.

 

Note: command to run the Jar in cluster

hadoop jar <jarName> <className> <arg1> <arg2>

 

Run  Arguments in Talend Job:

<className>

<arg1>

<arg2>

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Are you using tJava or tJavaRow components to write custom java code in your spark batch job?

Best regards

Sabrina