topic Re: Extracting table from Mysql to hive using talend in Talend Studio

Extracting table from Mysql to hive using talend

Anonymous — Sat, 16 Nov 2024 11:40:13 GMT

Hi,
I want to extract a table from mysql to hive using talend (big data studio)....
Can anyone guide me how to do that???

Re: Extracting table from Mysql to hive using talend

Anonymous — Mon, 28 Apr 2014 11:22:42 GMT

Hi,
You can use sqoop to import mysql table into hdfs firstly then using TalendHelpCenter:thiveload to write data into hive table.
Best regards
Sabrina

Re: Extracting table from Mysql to hive using talend

Anonymous — Tue, 29 Apr 2014 14:05:05 GMT

Thanks.

Re: Extracting table from Mysql to hive using talend

Anonymous — Wed, 30 Apr 2014 09:49:34 GMT

Hi seemi,
Is it working for you? Feel free to post your issue on forum.
Best regards
Sabrina

Re: Extracting table from Mysql to hive using talend

Anonymous — Mon, 05 May 2014 08:49:48 GMT

Hi.... I am able to extract tables to & from hdfs & mysql using sqoop, but the extraction is not in a table fromat from mysql to hive... I need help here...

& is there any other way to do this?? Coz... Talend is itself an ETL... (so I want to use its capablities to extract data using some mappings or anything else which is available .....

Re: Extracting table from Mysql to hive using talend

Anonymous — Mon, 05 May 2014 09:07:13 GMT

Hi,

Hi.... I am able to extract tables to & from hdfs & mysql using sqoop, but the extraction is not in a table fromat from mysql to hive... I need help here...

What's the actual result? Could you please upload the screenshots with us?
Best regards
Sabrina

Re: Extracting table from Mysql to hive using talend

Anonymous — Tue, 06 May 2014 14:00:40 GMT

Hi,
Hi.... I am able to extract tables to & from hdfs & mysql using sqoop, but the extraction is not in a table fromat from mysql to hive... I need help here...

What's the actual result? Could you please upload the screenshots with us?
Best regards
Sabrina

Hi Sabrina,
Attathced is the screen shot...
I have loaded the data into mysql... Now I want to load the same mysql table into hive without using sqoop.... Plz help me out...
Regards,
Seemi.

Re: Extracting table from Mysql to hive using talend

Anonymous — Wed, 07 May 2014 07:05:42 GMT

Hi,
It seems your screenshots are missing.
Pay more attention on limitation of Image Upload Section:20 images per post, each image must be less then 1024x768 pixels and 200 KB, png is preferred.

I have loaded the data into mysql... Now I want to load the same mysql table into hive without using sqoop.

Actually, you cannot load data from mysql to hive directly.
You could try tmysqlinput==>thdfsoutput then thiveload
Best regards
Sabrina

Re: Extracting table from Mysql to hive using talend

Anonymous — Wed, 07 May 2014 11:25:59 GMT

Hi,
It seems your screenshots are missing.
Pay more attention on limitation of Image Upload Section:20 images per post, each image must be less then 1024x768 pixels and 200 KB, png is preferred.

I have loaded the data into mysql... Now I want to load the same mysql table into hive without using sqoop.

Actually, you cannot load data from mysql to hive directly.
You could try tmysqlinput==>thdfsoutput then thiveload
Best regards
Sabrina

Hi,
I mable to extract my table from mysql to hdfs... but it is creating an empty table in hive... plz guide...

Re: Extracting table from Mysql to hive using talend

Anonymous — Fri, 09 May 2014 08:20:52 GMT

Can anyone tell me what does the following error means???

Query returned non-zero code: 1, cause: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
Query returned non-zero code: 1, cause: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Re: Extracting table from Mysql to hive using talend

Anonymous — Thu, 15 May 2014 14:12:09 GMT

I have a table in hive.... now i want to create another table in hive using the contents of already existing table in hive.... I am trying to use insert query but not able to do it.....

my query is :
"INSERT into table
importedcustomer
(
SELECT *
FROM databasename.customer
)"

plz guide me....

Re: Extracting table from Mysql to hive using talend

Anonymous — Fri, 16 May 2014 07:28:07 GMT

Hi,
Did you use TalendHelpCenter:tHiveRow to execute your query?
Best regards
Sabrina

Re: Extracting table from Mysql to hive using talend

Anonymous — Mon, 19 May 2014 07:14:33 GMT

Hi,
My issue is resolved now..... there were some permission errors......
Thnx a lot for your guidance.....

Re: Extracting table from Mysql to hive using talend

Anonymous — Mon, 26 May 2014 10:36:19 GMT

Hi....
I am trying to join tables in mysql & create a new table with that..... but getting error in that..
attaching the image ....

Error is as follows :

Exception in component tELTMysqlOutput_1
java.sql.SQLException: Access denied for user ''@'localhost' (using password: NO)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1074)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4096)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4028)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:919)
at com.mysql.jdbc.MysqlIO.secureAuth411(MysqlIO.java:4612)
at com.mysql.jdbc.MysqlIO.doHandshake(MysqlIO.java:1296)
at com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2412)
at com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2445)
at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2230)
at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:813)
at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:399)
at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:334)
at java.sql.DriverManager.getConnection(DriverManager.java:579)
at java.sql.DriverManager.getConnection(DriverManager.java:221)
at sampleproject.tjoinsql_0_1.tjoinsql.tELTMysqlMap_1Process(tjoinsql.java:457)
at sampleproject.tjoinsql_0_1.tjoinsql.tMysqlConnection_1Process(tjoinsql.java:1399)
at sampleproject.tjoinsql_0_1.tjoinsql.runJobInTOS(tjoinsql.java:1617)
at sampleproject.tjoinsql_0_1.tjoinsql.main(tjoinsql.java:1482)
disconnected
Job tjoinsql ended at 14:59 26/05/2014.

Re: Extracting table from Mysql to hive using talend

Anonymous — Tue, 27 May 2014 16:38:56 GMT

Exception in component tELTMysqlOutput_1
java.sql.SQLException: Access denied for user ''@'localhost' (using password: NO)

The error indicates wrong username/password, check that you have configured right connection parameters on tELTMysqlMap.
Shong

Re: Extracting table from Mysql to hive using talend

Anonymous — Wed, 28 May 2014 10:56:43 GMT

All the credentials are correct... but still it is showing the error..

Re: Extracting table from Mysql to hive using talend

Anonymous — Wed, 28 May 2014 16:10:03 GMT

Can you try to create a Mysql connection with the same credentials under Metadata of Repository perspective and check the connection? To me, it is really an authentication issue.

Shong