Hi,
I am getting the error when I am using the tsqoopimport to load the data to HDFS from MySQL.
Even I have used the tLibraryLoad to load "mysql-connector-java-5.1.37-bin.jar" & "sqoop-1.4.2.21.jar".
Screenshots are uploaded.
Please find the error below:
Starting job sqoop_to_hdfs at 23:40 03/11/2015.
connecting to socket on port 3602
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:363)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
at org.apache.hadoop.security.Groups.<init>(Groups.java:86)
at org.apache.hadoop.security.Groups.<init>(Groups.java:66)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:248)
at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:763)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2753)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2745)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2611)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:657)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
: org.apache.sqoop.ConnFactory - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
Note: \tmp\sqoop-SYakkala\compile\0b10b08dde744da71482faa9ca761012\emp.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
: org.apache.sqoop.manager.MySQLManager - It looks like you are importing from mysql.
: org.apache.sqoop.manager.MySQLManager - This transfer can be faster! Use the --direct
: org.apache.sqoop.manager.MySQLManager - option to exercise a MySQL-specific fast path.
: org.apache.sqoop.tool.ImportTool - Encountered IOException running import job: java.io.IOException: Could not load jar \tmp\sqoop-SYakkala\compile\0b10b08dde744da71482faa9ca761012\emp.jar into JVM. (Could not find class emp.)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
at org.apache.sqoop.mapreduce.JobBase.loadJars(JobBase.java:230)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:192)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:465)
at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:108)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:403)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:692)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
Caused by: java.lang.ClassNotFoundException: emp
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
... 15 more
Exception in component tSqoopImport_1
java.lang.Exception: The Sqoop import job has failed. Please check the logs.
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:696)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
disconnected
Job sqoop_to_hdfs ended at 23:40 03/11/2015.
