big data job

Jaggu1992 — Mon, 27 Jan 2020 11:54:16 GMT

HI All,

This is the error message i am getting when i ran Talend bigdata Job.

Note:-

1) In host file i Have given IP address

2)window-->preferences--->Talend---->-Dhadoop.home.dir=C:\\winutil\\

3)I have created hadoop cluster and then i have created hdfs.But then also iam getting this error.

[statistics] connecting to socket on port 3415
[statistics] connected
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[ERROR]: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:404)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:419)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:412)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:168)
at org.apache.hadoop.security.Groups.<init>(Groups.java:132)
at org.apache.hadoop.security.Groups.<init>(Groups.java:100)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:435)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:337)
at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:374)
at local_project.customer_0_1.customer.tHDFSGet_1Process(customer.java:320)
at local_project.customer_0_1.customer.runJobInTOS(customer.java:773)
at local_project.customer_0_1.customer.main(customer.java:623)
[statistics] disconnected

Thanks,

Jagan.

Re: big data job

Anonymous — Mon, 27 Jan 2020 13:53:31 GMT

Hi,

One of the solutions here (https://help.talend.com/search/all?query=The+missing+winutils.exe+program+in+the+Big+Data+Jobs&content-lang=en) should be of help to you I believe.

Regards

Richard

topic big data job in Talend Studio

big data job

Re: big data job