topic Re: tPigLoad component issue with Cloudera 5 in Talend Studio

tPigLoad component issue with Cloudera 5

Anonymous — Sat, 16 Nov 2024 11:30:38 GMT

Hi Gurus.
Quick question is had anyone ever get the tPigload component working with cloudera5
I am using cloudera 5
talend 5.4 and 5.5 <none worked>
where ever there is a scope of map reduce talend is complaining.
Following is the error description:
Exception in component tPigLoad_1
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1000: Error during parsing. Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1608)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1547)
at org.apache.pig.PigServer.registerQuery(PigServer.java:518)
at org.apache.pig.PigServer.registerQuery(PigServer.java:531)
at bigdata.testpig_0_1.testpig.tPigLoad_1Process(testpig.java:348)
at bigdata.testpig_0_1.testpig.runJobInTOS(testpig.java:599)
at bigdata.testpig_0_1.testpig.main(testpig.java:458)
Caused by: Failed to parse: Pig script failed to parse:
<line 1, column 21> pig script failed to validate: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1600)
... 6 more
Caused by:
<line 1, column 21> pig script failed to validate: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:835)
at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3236)
at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1315)
at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:799)
at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:517)
at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:392)
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:184)
... 7 more
Caused by: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:207)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:128)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:138)
at org.apache.pig.parser.QueryParserUtils.getCurrentDir(QueryParserUtils.java:91)
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:827)
... 13 more
Caused by: java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "TXWLHPW295/10.215.206.241"; destination host is: "txwlcloud2":8020;

Re: tPigLoad component issue with Cloudera 5

Anonymous — Wed, 22 Oct 2014 05:36:46 GMT

Hi,

ERROR 6007: Unable to check name hdfs://txwlcloud2:8020/user/thor

Make sure your input parameter is totally correct. Have you checked component reference TalendHelpCenter:tPigLoad?
Best regards
Sabrina

Re: tPigLoad component issue with Cloudera 5

Anonymous — Tue, 28 Oct 2014 23:31:43 GMT

Hi Team, Am getting the following error while storing data into HBase using tPigStoreResult (store function : HBaseStorage)
Please to the attachment for job design and complete stacktrace below.
Starting job Main_e at 15:15 28/10/2014.
connecting to socket on port 3342
connected
: org.apache.hadoop.conf.Configuration.deprecation - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
: org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
: org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
: org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost.localdomain:8022
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

To see the whole post, download it here
OriginalPost.pdf

Re: tPigLoad component issue with Cloudera 5

Anonymous — Tue, 28 Oct 2014 23:33:32 GMT