Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

tPigLoad component issue with Cloudera 5

Hi Gurus.
Quick question is had anyone ever get the tPigload component working with cloudera5 
I am using cloudera 5 
talend 5.4 and 5.5 <none worked>
where ever there is a scope of map reduce talend is complaining.
Following is the error description:
Exception in component tPigLoad_1
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1000: Error during parsing. Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1608)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1547)
at org.apache.pig.PigServer.registerQuery(PigServer.java:518)
at org.apache.pig.PigServer.registerQuery(PigServer.java:531)
at bigdata.testpig_0_1.testpig.tPigLoad_1Process(testpig.java:348)
at bigdata.testpig_0_1.testpig.runJobInTOS(testpig.java:599)
at bigdata.testpig_0_1.testpig.main(testpig.java:458)
Caused by: Failed to parse: Pig script failed to parse: 
<line 1, column 21> pig script failed to validate: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1600)
... 6 more
Caused by: 
<line 1, column 21> pig script failed to validate: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:835)
at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3236)
at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1315)
at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:799)
at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:517)
at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:392)
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:184)
... 7 more
Caused by: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:207)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:128)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:138)
at org.apache.pig.parser.QueryParserUtils.getCurrentDir(QueryParserUtils.java:91)
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:827)
... 13 more
Caused by: java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "TXWLHPW295/10.215.206.241"; destination host is: "txwlcloud2":8020; 
0683p000009MEqi.png
Labels (3)
3 Replies
Anonymous
Not applicable
Author

Hi,
ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor

Make sure your input parameter is totally correct. Have you checked component reference TalendHelpCenter:tPigLoad?
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi Team, Am getting the following error while storing data into HBase using tPigStoreResult (store function : HBaseStorage)
Please to the attachment for job design and complete stacktrace below.
Starting job Main_e at 15:15 28/10/2014.
connecting to socket on port 3342
connected
: org.apache.hadoop.conf.Configuration.deprecation - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
: org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
: org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
: org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost.localdomain:8022
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

To see the whole post, download it here
OriginalPost.pdf
Anonymous
Not applicable
Author

Hi Team, Am getting the following error while storing data into HBase using tPigStoreResult (store function : HBaseStorage)
Please to the attachment for job design and complete stacktrace below.
Starting job Main_e at 15:15 28/10/2014.
connecting to socket on port 3342
connected
: org.apache.hadoop.conf.Configuration.deprecation - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
: org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
: org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
: org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost.localdomain:8022
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

To see the whole post, download it here
OriginalPost.pdf