Hi All,
while loading data from mysql to hdfs cloudera using tsqoopimport getting error, find below attached images for tsqoopimport connection property.
connecting to socket on port 3594
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
: org.apache.sqoop.ConnFactory - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
Note: \tmp\sqoop-sandy\compile\3befc30f098ef6b7719b6ec4cd51ea91\test.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
: org.apache.sqoop.mapreduce.JobBase - SQOOP_HOME is unset. May not be able to find all job dependencies.
Exception in component tSqoopImport_1
java.lang.Exception: The Sqoop import job has failed. Please check the logs.
at local_project.mysql_to_hdfs_sqoop_0_1.mysql_to_hdfs_sqoop.tSqoopImport_1Process(mysql_to_hdfs_sqoop.java:386)
at local_project.mysql_to_hdfs_sqoop_0_1.mysql_to_hdfs_sqoop.runJobInTOS(mysql_to_hdfs_sqoop.java:660)
at local_project.mysql_to_hdfs_sqoop_0_1.mysql_to_hdfs_sqoop.main(mysql_to_hdfs_sqoop.java:517)
: org.apache.sqoop.tool.ImportTool - Encountered IOException running import job: java.io.IOException: Job status not available
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:334)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:621)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1366)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1328)
at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266)
at org.apache.sqoop.manager.DirectMySQLManager.importTable(DirectMySQLManager.java:92)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at local_project.mysql_to_hdfs_sqoop_0_1.mysql_to_hdfs_sqoop.tSqoopImport_1Process(mysql_to_hdfs_sqoop.java:382)
at local_project.mysql_to_hdfs_sqoop_0_1.mysql_to_hdfs_sqoop.runJobInTOS(mysql_to_hdfs_sqoop.java:660)
at local_project.mysql_to_hdfs_sqoop_0_1.mysql_to_hdfs_sqoop.main(mysql_to_hdfs_sqoop.java:517)
disconnected
Job mysql_to_hdfs_sqoop ended at 17:21 12/03/2017.
Hi, Thank you for your post! We can't see the screenshot on our side. Could you attach it on the forum, please? That would be great. Best regards Sabrina