Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

only 1 row with null values flowing through my tPigLoad components

Hi all,

 

I am using :

- Talend Open Studio for Big Data 6.4.1 on Windows 10 pro (x64)

- with Hadoop v2.0 on the cloud, provided by IBM demo cloud and powered by redhat6 x86_64

 

My job should normally use 2 tPigLoad components to import 2 tables from HDFS (1 main and 1 ref), do the lookup mapping with tPigMap, and export 2 tables (results and rejects) in a new HDFS directory with tPigStoreResult. 

 

It is running without ending, while the data flow ends on the design panel with only 1 row processed with null values (cf. please see attachment). The output directory is not created.

 

Also, I get 2 warnings :

 

[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.pig.PigServer - Empty string specified for jar path

 

Looking at Java debugging perspective doesn't give more info ...

 

Would you please have an idea of what is going on ?

 

Best regards, Sélim

Labels (1)
10 Replies
Anonymous
Not applicable
Author

Hi Sabrina,

 

unfortunately the HBase RegionServer Process does not repond from 2 of my data nodes and my last data node is not responding any hearttbeat at all. I have let a message to IBM which provides the cloud as a service cluster, but I see no answer from them in other topics of the forum. Maybe for the moment I could keep the PigStorage option ?

 

I have tried without lookup but I get the same error ...

 

Good evening