Sqoop Export to MySQL issue

Anonymous — Sat, 16 Nov 2024 11:43:39 GMT

Hi,
I am using talend platform for MDM Big Data 5.3.1. r104014 on Windows 7 with Hortonworks HDP v1.2.0 Bimota
Exporting a simple table from HDFS to MySQL t00_stocks with 5 rows faails. Please help.

Error log
Starting job t11_Sqoop_Export_fromHDFS_toMySQL at 22:11 06/03/2014.

connecting to socket on port 3727
connected
14/03/06 22:11:46 WARN sqoop.ConnFactory: $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
14/03/06 22:11:46 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/03/06 22:11:46 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/03/06 22:11:46 DEBUG manager.DefaultManagerFactory: Trying with scheme: jdbc:mysql:
14/03/06 22:11:46 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/03/06 22:11:46 DEBUG sqoop.ConnFactory: Instantiated ConnManager org.apache.sqoop.manager.MySQLManager@100ce93f
14/03/06 22:11:46 INFO tool.CodeGenTool: Beginning code generation
14/03/06 22:11:46 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection.
14/03/06 22:11:47 DEBUG manager.SqlManager: Using fetchSize for next query: -2147483648
14/03/06 22:11:47 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `t00_stocks` AS t LIMIT 1
14/03/06 22:11:47 DEBUG orm.ClassWriter: selected columns:
14/03/06 22:11:47 DEBUG orm.ClassWriter: id
14/03/06 22:11:47 DEBUG orm.ClassWriter: stock_symbol
14/03/06 22:11:47 DEBUG orm.ClassWriter: price
14/03/06 22:11:47 DEBUG orm.ClassWriter: category
14/03/06 22:11:47 DEBUG manager.SqlManager: Using fetchSize for next query: -2147483648
14/03/06 22:11:47 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `t00_stocks` AS t LIMIT 1
14/03/06 22:11:47 DEBUG orm.ClassWriter: Writing source file: \tmp\sqoop-Amit\compile\a68839d0bd16f8b56d88816955390ddb\t00_stocks.java
14/03/06 22:11:47 DEBUG orm.ClassWriter: Table name: t00_stocks
14/03/06 22:11:47 DEBUG orm.ClassWriter: Columns: id:12, stock_symbol:12, price:12, category:12,
14/03/06 22:11:47 DEBUG orm.ClassWriter: sourceFilename is t00_stocks.java
disconnected
14/03/06 22:11:47 DEBUG orm.CompilationManager: Found existing \tmp\sqoop-Amit\compile\a68839d0bd16f8b56d88816955390ddb\
14/03/06 22:11:47 INFO orm.CompilationManager: $HADOOP_HOME is not set
14/03/06 22:11:47 ERROR orm.CompilationManager: It seems as though you are running sqoop with a JRE.
14/03/06 22:11:47 ERROR orm.CompilationManager: Sqoop requires a JDK that can compile Java code.
14/03/06 22:11:47 ERROR orm.CompilationManager: Please install a JDK and set $JAVA_HOME to use it.
14/03/06 22:11:47 ERROR tool.ExportTool: Encountered IOException running export job: java.io.IOException: Could not start Java compiler.
Exception in component tSqoopExport_1
java.lang.Exception: The Sqoop export job has failed
at t01_bd_bimota_01.t11_sqoop_export_fromhdfs_tomysql_0_1.t11_Sqoop_Export_fromHDFS_toMySQL.tSqoopExport_1Process(t11_Sqoop_Export_fromHDFS_toMySQL.java:657)
at t01_bd_bimota_01.t11_sqoop_export_fromhdfs_tomysql_0_1.t11_Sqoop_Export_fromHDFS_toMySQL.runJobInTOS(t11_Sqoop_Export_fromHDFS_toMySQL.java:1005)
at t01_bd_bimota_01.t11_sqoop_export_fromhdfs_tomysql_0_1.t11_Sqoop_Export_fromHDFS_toMySQL.main(t11_Sqoop_Export_fromHDFS_toMySQL.java:743)
Job t11_Sqoop_Export_fromHDFS_toMySQL ended at 22:11 06/03/2014.

Re: Sqoop Export to MySQL issue

Anonymous — Thu, 06 Mar 2014 22:32:04 GMT

Hi,
It looks like you dont have JDK version installed on your machine were you are executing talend job.
Install java JDK and go to the preferences -> talend -> mention the path of java interpreter i.e. java.exe from jdk bin directory.

Regards
Gokul

Re: Sqoop Export to MySQL issue

Anonymous — Fri, 07 Mar 2014 04:59:23 GMT

Hi,
For your talend platform for MDM Big Data product, you'd better report a ticket on Talend Support Portal, our colleagues from support team will schedule a webex with you to give a remote assistance.
Best regards
Sabrina

topic Re: Sqoop Export to MySQL issue in Talend Studio

Sqoop Export to MySQL issue

Re: Sqoop Export to MySQL issue

Re: Sqoop Export to MySQL issue