I have a simple one-component job in TAC. It consists of a single tHDFSPut component with all settings completed. When I run the job in TOS, I'm getting this error:
Starting job job_Push_Files_to_HDFS at 10:42 05/04/2019.
[statistics] connecting to socket on port 3919
[statistics] connected
Starting BASIC HDFS Put
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[ERROR]: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:407)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:422)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:415)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:168)
at org.apache.hadoop.security.Groups.<init>(Groups.java:132)
at org.apache.hadoop.security.Groups.<init>(Groups.java:100)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:435)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:337)
at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:374)
at content_operations.job_push_files_to_hdfs_0_1.job_Push_Files_to_HDFS.tHDFSPut_1Process(job_Push_Files_to_HDFS.java:692)
at content_operations.job_push_files_to_hdfs_0_1.job_Push_Files_to_HDFS.tJava_2Process(job_Push_Files_to_HDFS.java:504)
at content_operations.job_push_files_to_hdfs_0_1.job_Push_Files_to_HDFS.runJobInTOS(job_Push_Files_to_HDFS.java:1200)
at content_operations.job_push_files_to_hdfs_0_1.job_Push_Files_to_HDFS.main(job_Push_Files_to_HDFS.java:971)
No match file(*.gz) exists!
No match file(*.txt) exists!
[ERROR]: content_operations.job_push_files_to_hdfs_0_1.job_Push_Files_to_HDFS - tHDFSPut_1 - No match file(*.gz) exists!
[ERROR]: content_operations.job_push_files_to_hdfs_0_1.job_Push_Files_to_HDFS - tHDFSPut_1 - No match file(*.txt) exists!
[statistics] disconnected
Job job_Push_Files_to_HDFS ended at 10:42 05/04/2019. [exit code=0]
Then, when I run the same job in TAC, I'm getting this error:
java.lang.RuntimeException: org.talend.designer.runprocess.ProcessorException: org.talend.commons.exception.PersistenceException: org.talend.designer.runprocess.ProcessorException: Job compile errors
At least job "job_Push_Files_to_HDFS" has a compile errors, please fix and export again.
Error Line: 713
Detail Message: org.apache.hadoop cannot be resolved to a type
There may be some other errors caused by JVM compatibility. Make sure your JVM setup is similar to the studio.
at org.talend.commandline.command.ExtensionCommandSwitch.caseExtensionServerCommand(ExtensionCommandSwitch.java:191)
at org.talend.commandline.client.command.extension.AbstractExtensionCommandSwitch.doSwitch(AbstractExtensionCommandSwitch.java:31)
at org.talend.commandline.command.CommandProcessorSwitch.caseExtensionCommand(CommandProcessorSwitch.java:179)
at org.talend.commandline.client.util.CommandAbstractSwitch.doSwitch(CommandAbstractSwitch.java:70)
at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:57)
at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:35)
at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.talend.designer.runprocess.ProcessorException: org.talend.commons.exception.PersistenceException: org.talend.designer.runprocess.ProcessorException: Job compile errors
At least job "job_Push_Files_to_HDFS" has a compile errors, please fix and export again.
Could this be related to missing jar files or something? I've already installed the required files when I first placed the component in the workspace.
