TALEND BD 7 PigLoad issue

Anonymous — Sat, 16 Nov 2024 07:44:31 GMT

Greetings

I have an issue with running pigload component in Talend Job
Env is macOS i.e. Talend BD vs 7 using cloudera sandpit vm ( 5.13) ;

Talend HDFS/HIVE components are all fine i.e. connecting , reading and writing etc ; PIG code works via grunt on the CLH cluster etc ; just not via Talend i.e.

; sequence is connect>>fixedflow>>HDFSOutput>>PigLoad>>PigFilter>>PigStore ;

Any suggestions to debug/check appreciated....

Starting job pig_filterColumns at 12:08 31/08/2018.

[statistics] connecting to socket on port 3637

[statistics] connected

[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

[WARN ]: org.apache.pig.PigServer - Empty string specified for jar path

Exception in thread "main" java.lang.NoClassDefFoundError: org/antlr/runtime/RecognitionException

at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1687)

at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1635)

at org.apache.pig.PigServer.registerQuery(PigServer.java:587)

at org.apache.pig.PigServer.registerQuery(PigServer.java:600)

at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.tPigLoad_1Process(pig_filterColumns.java:1923)

at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.tFixedFlowInput_1Process(pig_filterColumns.java:1151)

at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.runJobInTOS(pig_filterColumns.java:3216)

at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.main(pig_filterColumns.java:3007)

Caused by: java.lang.ClassNotFoundException: org.antlr.runtime.RecognitionException

at java.net.URLClassLoader.findClass(URLClassLoader.java:381)

at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)

at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

... 8 more

[statistics] disconnected

Job pig_filterColumns ended at 12:09 31/08/2018. [exit code=1]

Re: TALEND BD 7 PigLoad issue

vapukov — Sun, 02 Sep 2018 15:23:55 GMT

Generally if You want run BD components from Studio - You must have them installed and configured on local machine

hdfs and other components

in case of sandbox - build Job from Studio and transfer all to Cloudera VM, run it locally on VM

as alternative - install Studio inside VM if You test only

Re: TALEND BD 7 PigLoad issue

Anonymous — Mon, 03 Sep 2018 01:17:14 GMT

Thanks ,

I'll install studio on VM and then try from there ;

Thnks

topic TALEND BD 7 PigLoad issue in Talend Studio

TALEND BD 7 PigLoad issue

Re: TALEND BD 7 PigLoad issue

Re: TALEND BD 7 PigLoad issue