Calling Hadoop Java code in MapReduce Job

Anonymous — Sat, 16 Nov 2024 07:57:44 GMT

HI Team,

I have a custom java code which was written using MapReduce libraries. I was able to run the jar file successfully on Hadoop cluster. But, while I am running the same jar in "Big Data Batch Job" with tLibraryLoad, I am getting Error like, could not be able to load main class.Could any one help me, what am I missing.

Note: command to run the Jar in cluster

hadoop jar <jarName> <className> <arg1> <arg2>

Run Arguments in Talend Job:

<arg1>

<arg2>

Re: Calling Hadoop Java code in MapReduce Job

Anonymous — Mon, 30 Jul 2018 08:23:24 GMT

Hello,

Are you using tJava or tJavaRow components to write custom java code in your spark batch job?

Best regards

Sabrina

topic Re: Calling Hadoop Java code in MapReduce Job in Talend Studio

Calling Hadoop Java code in MapReduce Job

Re: Calling Hadoop Java code in MapReduce Job