Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik GA: Multivariate Time Series in Qlik Predict: Get Details
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

tPigLoad cannot load any file from HDFS, it is getting the null value

Hi, Guys
I am using your talend big data open studio to testing for big data, and running into an issue
When I tried to use tPigLoad to load file in HDFS, it gives the error please see the screen shot.
I have tried every solution in google, but none does work.

this is my testing schema in hdfs

please help me. Thank you!

I don't know why the screen shot is missed
please see the error
Starting job T_Pigload_Test at 03:08 10/08/2015.
connecting to socket on port 3587
connected
connecting to socket on port 4700
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
objc: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.8.0_11.jdk/Contents/Home/bin/java and /Library/Java/JavaVirtualMachines/jdk1.8.0_11.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
: org.apache.hadoop.mapreduce.JobSubmitter - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
: org.apache.hadoop.mapreduce.JobSubmitter - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
: org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed!
disconnected
disconnected
Job T_Pigload_Test ended at 03:09 10/08/2015.
0683p000009MBJQ.png
0683p000009MBGD.png
0683p000009MBJa.png
Labels (4)
13 Replies
Anonymous
Not applicable
Author

Hi, 
When i export the job and run it as shell script, this is the error message i get.
6/02/01 20:25:13 INFO mapReduceLayer.MapReduceLauncher: job job_1454362501785_0008 has failed! Stop running all dependent jobs
6/02/01 20:25:13 INFO mapReduceLayer.MapReduceLauncher: 100% complete
6/02/01 20:25:13 INFO client.RMProxy: Connecting to ResourceManager at /10.56.70.93:8032
6/02/01 20:25:13 INFO client.RMProxy: Connecting to ResourceManager at /10.56.70.93:8032
6/02/01 20:25:13 ERROR mapreduce.MRPigStatsUtil: 1 map reduce job(s) failed!
6/02/01 20:25:13 INFO mapreduce.SimplePigStats: Script Statistics: 
HadoopVersionPigVersionUserIdStartedAtFinishedAtFeatures
2.7.1.2.3.2.0-29500.15.0.2.3.2.0-2950skrithika2016-02-01 20:25:072016-02-01 20:25:13UNKNOWN
Failed!
Failed Jobs:
JobIdAliasFeatureMessageOutputs
job_1454362501785_0008tPigLoad_1_row1_RESULTMAP_ONLYMessage: Job failed!/user/skrithika/pigstore,
Input(s):
Failed to read data from "/user/skrithika/test_data/data.txt"
Output(s):
Failed to produce result in "/user/skrithika/pigstore"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_1454362501785_0008

16/02/01 20:25:13 INFO mapReduceLayer.MapReduceLauncher: Failed!
Anonymous
Not applicable
Author

Hi,
Have you already checked document: TalendHelpCenter0683p000009M9p6.pngupported Hadoop distribution versions to see if you are on supported Hadoop distribution?
Best regards
Sabrina
Anonymous
Not applicable
Author

Yes, it is supported. Checked. This could be a yarn issue? 
Anonymous
Not applicable
Author

it looks more like a code generation issue.