Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Greetings
I have an issue with running pigload component in Talend Job
Env is macOS i.e. Talend BD vs 7 using cloudera sandpit vm ( 5.13) ;
Talend HDFS/HIVE components are all fine i.e. connecting , reading and writing etc ; PIG code works via grunt on the CLH cluster etc ; just not via Talend i.e.
; sequence is connect>>fixedflow>>HDFSOutput>>PigLoad>>PigFilter>>PigStore ;
Any suggestions to debug/check appreciated....
Starting job pig_filterColumns at 12:08 31/08/2018.
[statistics] connecting to socket on port 3637
[statistics] connected
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.pig.PigServer - Empty string specified for jar path
Exception in thread "main" java.lang.NoClassDefFoundError: org/antlr/runtime/RecognitionException
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1687)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1635)
at org.apache.pig.PigServer.registerQuery(PigServer.java:587)
at org.apache.pig.PigServer.registerQuery(PigServer.java:600)
at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.tPigLoad_1Process(pig_filterColumns.java:1923)
at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.tFixedFlowInput_1Process(pig_filterColumns.java:1151)
at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.runJobInTOS(pig_filterColumns.java:3216)
at bd_demo_project.pig_filtercolumns_0_1.pig_filterColumns.main(pig_filterColumns.java:3007)
Caused by: java.lang.ClassNotFoundException: org.antlr.runtime.RecognitionException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 8 more
[statistics] disconnected
[statistics] disconnected
Job pig_filterColumns ended at 12:09 31/08/2018. [exit code=1]
Generally if You want run BD components from Studio - You must have them installed and configured on local machine
hdfs and other components
in case of sandbox - build Job from Studio and transfer all to Cloudera VM, run it locally on VM
as alternative - install Studio inside VM if You test only
Thanks ,
I'll install studio on VM and then try from there ;
Thnks