tsqoopimport error

Anonymous — Sat, 16 Nov 2024 10:57:53 GMT

Hi,
I am getting the error when I am using the tsqoopimport to load the data to HDFS from MySQL.
Even I have used the tLibraryLoad to load "mysql-connector-java-5.1.37-bin.jar" & "sqoop-1.4.2.21.jar".
Screenshots are uploaded.

Please find the error below:
Starting job sqoop_to_hdfs at 23:40 03/11/2015.
connecting to socket on port 3602
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:363)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
at org.apache.hadoop.security.Groups.<init>(Groups.java:86)
at org.apache.hadoop.security.Groups.<init>(Groups.java:66)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:248)
at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:763)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2753)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2745)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2611)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:657)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
: org.apache.sqoop.ConnFactory - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
Note: \tmp\sqoop-SYakkala\compile\0b10b08dde744da71482faa9ca761012\emp.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
: org.apache.sqoop.manager.MySQLManager - It looks like you are importing from mysql.
: org.apache.sqoop.manager.MySQLManager - This transfer can be faster! Use the --direct
: org.apache.sqoop.manager.MySQLManager - option to exercise a MySQL-specific fast path.
: org.apache.sqoop.tool.ImportTool - Encountered IOException running import job: java.io.IOException: Could not load jar \tmp\sqoop-SYakkala\compile\0b10b08dde744da71482faa9ca761012\emp.jar into JVM. (Could not find class emp.)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
at org.apache.sqoop.mapreduce.JobBase.loadJars(JobBase.java:230)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:192)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:465)
at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:108)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:403)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:692)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
Caused by: java.lang.ClassNotFoundException: emp
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
... 15 more
Exception in component tSqoopImport_1
java.lang.Exception: The Sqoop import job has failed. Please check the logs.
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:696)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
disconnected
Job sqoop_to_hdfs ended at 23:40 03/11/2015.

Re: tsqoopimport error

Anonymous — Wed, 04 Nov 2015 08:43:44 GMT

screenshots are here :

Re: tsqoopimport error

Anonymous — Wed, 04 Nov 2015 08:48:42 GMT

screenshots are uploaded. My apologies for multiple messages.

Re: tsqoopimport error

Anonymous — Wed, 04 Nov 2015 09:01:55 GMT

Hi,

Can you upload again the screenshots you wanted to show, please? For some reason it didn't make it to your post.(you can edit your previous posts and post your screenshot).

Best regards
Sabrina

Re: tsqoopimport error

Anonymous — Wed, 04 Nov 2015 09:09:08 GMT

Hi,
Please find the screenshots:

Re: tsqoopimport error

Anonymous — Thu, 05 Nov 2015 21:22:32 GMT

please help me regarding this error...

Re: tsqoopimport error

Anonymous — Mon, 14 Dec 2015 03:46:29 GMT

Hi,
Here is a kb article about TalendHelpCenter:The missing winutils.exe program in the Big Data Jobs
Best regards
Sabrina

topic Re: tsqoopimport error in Talend Studio

tsqoopimport error

Re: tsqoopimport error

Re: tsqoopimport error

Re: tsqoopimport error

Re: tsqoopimport error

Re: tsqoopimport error

Re: tsqoopimport error