Sqoop Component doesnt work after upgrade from MapR 3.1.0 to 4.0.1

Anonymous — Sat, 16 Nov 2024 11:15:33 GMT

Hi Talend team,
We have updgraded our MapR cluster from 3.1.0 to 4.0.1 and after the upgrade the Sqoop component doesn't work. Earlier Sqoop was working with Talend 5.5 and MapR 3.1.0. We tested with Talend 5.5 and 5.6 after the upgrade but it doesn't work in both the scenarios.
Below is the error message when we run the job:
$ ./SqoopImportPRPT_run.sh
15/04/09 00:27:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/04/09 00:27:34 INFO security.JniBasedUnixGroupsMappingWithFallback: Falling back to shell based
15/04/09 00:27:34 WARN sqoop.ConnFactory: $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
15/04/09 00:27:34 INFO manager.SqlManager: Using default fetchSize of 1000
15/04/09 00:27:34 INFO tool.CodeGenTool: Beginning code generation
15/04/09 00:27:35 INFO manager.OracleManager: Time zone has been set to GMT
15/04/09 00:27:35 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM XXBRM_SITE_SERVICE_MAP t WHERE 1=0
15/04/09 00:27:36 INFO orm.CompilationManager: $HADOOP_HOME is not set
Note: /tmp/sqoop-hdpsbp/compile/d967dd0b4a360c6041d92b3bf319b992/XXBRM_SITE_SERVICE_MAP.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
15/04/09 00:27:37 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hdpsbp/compile/d967dd0b4a360c6041d92b3bf319b992/XXBRM_SITE_SERVICE_MAP.jar
15/04/09 00:27:37 INFO mapreduce.ImportJobBase: Beginning import of XXBRM_SITE_SERVICE_MAP
15/04/09 00:27:37 INFO manager.OracleManager: Time zone has been set to GMT
15/04/09 00:27:37 WARN mapreduce.JobBase: SQOOP_HOME is unset. May not be able to find all job dependencies.
15/04/09 00:27:37 ERROR ipc.RPC: FailoverProxy: Failing this Call: getStagingAreaDir for error(RemoteException): org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
15/04/09 00:27:37 ERROR tool.ImportTool: Encountered IOException running import job: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
at org.apache.hadoop.ipc.Client.call(Client.java:1142)
at org.apache.hadoop.ipc.Client.call(Client.java:1088)
at org.apache.hadoop.ipc.RPC$FailoverInvoker.invoke(RPC.java:540)
at org.apache.hadoop.mapred.$Proxy2.getStagingAreaDir(Unknown Source)
at org.apache.hadoop.mapred.JobClient.getStagingAreaDir(JobClient.java:1337)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:102)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:902)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:896)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1117)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:896)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:573)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:603)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:141)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:202)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:465)
at org.apache.sqoop.manager.OracleManager.importTable(OracleManager.java:380)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:403)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at abhinay_demo.sqoopimportprpt_0_1.SqoopImportPRPT.tSqoopImport_1Process(SqoopImportPRPT.java:489)
at abhinay_demo.sqoopimportprpt_0_1.SqoopImportPRPT.tLibraryLoad_1Process(SqoopImportPRPT.java:367)
at abhinay_demo.sqoopimportprpt_0_1.SqoopImportPRPT.runJobInTOS(SqoopImportPRPT.java:731)
at abhinay_demo.sqoopimportprpt_0_1.SqoopImportPRPT.main(SqoopImportPRPT.java:614)
Regards,
Shanker

Re: Sqoop Component doesnt work after upgrade from MapR 3.1.0 to 4.0.1

Anonymous — Mon, 20 Apr 2015 04:56:38 GMT

Hi Shanker,
Have you already created a jira issue on Talend Bug Tracker?
Best regards
Sabrina

topic Re: Sqoop Component doesnt work after upgrade from MapR 3.1.0 to 4.0.1 in Talend Studio

Sqoop Component doesnt work after upgrade from MapR 3.1.0 to 4.0.1

Re: Sqoop Component doesnt work after upgrade from MapR 3.1.0 to 4.0.1