topic Re: tSqoopImport tHDFSPut in Talend Studio

tSqoopImport tHDFSPut

Anonymous — Sat, 16 Nov 2024 12:05:10 GMT

Hi everybody,
is there any simple scenario where we user the thow compoennts: tsqoopImport and tHDFSPut.
i want to store atable imported by sqoop on the HDFS.
Thank you! 😃

Re: tSqoopImport tHDFSPut

Anonymous — Tue, 12 Mar 2013 10:33:16 GMT

Hi,
Here are component references with scenario tHDFSPut and tSqoopImport.
You can check the Sqoop database version and system supported by talend from here:https://help.talend.com/search/all?query=Supported+systems+and+databases&content-lang=en
Best regards
Sabrina

Re: tSqoopImport tHDFSPut

Anonymous — Tue, 12 Mar 2013 11:14:56 GMT

Thank you Sabrina for answring.
my problem is that don't see the "connection" between tSqoopImport and the HDFS.
i looked at the tsqoopImport's properties and there are no directions to a HDFS location.
I'am a Hadoop newbie, it's new to me ^^"

Re: tSqoopImport tHDFSPut

Anonymous — Tue, 19 Mar 2013 23:21:18 GMT

Hi
I believe you need to use the "advance tab" and add a parameter
--target-dir <dir>

Ciaran

Re: tSqoopImport tHDFSPut

Anonymous — Mon, 25 Mar 2013 04:53:47 GMT

Hi,
In the version you use, talend uses the Sqoop CLI to execute a Sqoop job. That means the talend job has to be executed on the same server Sqoop is installed on. That's why we don't need a HDFS connection... Because the job is executed from the cluster directly.
It's a know limitation which is gonna be fixed in 5.3 with the ability to use the Java API.
HTH,
Rémy.

Re: tSqoopImport tHDFSPut

Anonymous — Wed, 17 Apr 2013 11:11:53 GMT

Hi all,
i get this error when running a simple job with tSqoopImport component. I specified the necessary parameters.
general parameter
connexion :"jdbc racle:thin:@//dwdv:1511/dbdev"
utilisateur: "user"
mot de passe : "pass"
nom de la table: "tablename"
advanced parameter
the columns, targetdir and the split by.
my database is Oracle as shown.
in the parameter "Connexion", do you have idea about the structure of ORACLE connection? "jdbc racle:thin..." ?
thanks!