topic How to import Oracle database data to Hive in Talend Studio

How to import Oracle database data to Hive

Anonymous — Sat, 16 Nov 2024 11:54:19 GMT

Hello All,
I have Oracle 11g database it contain the schema which has tables and there data.
What i need is import all this data in to Hive. i searched about this , and what i got is use tSqoopImport. and this video
http://www.youtube.com/watch?v=wsmL2_fxuEQ
but when i follows the steps given in this video i am not getting what to use for Hive component to import data .
can any one tell me how to do this.

thank you.

Re: How to import Oracle database data to Hive

Anonymous — Wed, 18 Sep 2013 07:26:47 GMT

Hi,
So far, there is no such tHiveImport component in talend product.
There is a forum about how to copy DB, hope it will point a light on your issue
https://community.talend.com/t5/Design-and-Development/Copy-a-database/td-p/106219
Best regards
Sabrina

Re: How to import Oracle database data to Hive

Anonymous — Wed, 18 Sep 2013 07:34:17 GMT

thanks Sabrina.
Is there any alternate solution for my problem.
how i import Relational database that is oracle database into Nosql database that is Hive.
Talend has tSpooqImport component but i am not getting how to use this in my scenario.
Can you help me on this.
Thanks & Regards
Snehal

Re: How to import Oracle database data to Hive

Anonymous — Wed, 18 Sep 2013 08:08:32 GMT

Hi,
I have a way you can use tSqoopImport to transfer data from oracle to hdfs then load the hdfs data to Hive using tHiveRow.
Let me know if it is OK with your requirement.
Best regards
Sabrina

Re: How to import Oracle database data to Hive

Anonymous — Wed, 18 Sep 2013 08:36:50 GMT

Hi Sabrina,
thank you for reply. i am trying how u told. what i did is shown in image.
i am not getting how to link this to achieve my goal.

please can you help me on this.

thanks & Regards
Snehal

Re: How to import Oracle database data to Hive

Anonymous — Fri, 27 Sep 2013 12:30:37 GMT

Hello,
IMHO, the good solution would be to use Sqoop.
You can create an external table into hive which points out a HDFS location. Then, you can use the tSqoopImport in order to import the Oracle table into HDFS (at the location you defined in your hive table creation).
Then your data will be available using Hive.

HTH,
Rémy.