topic Re: How to get DATA from multiple tables at onece in ETL ??? in Talend Studio

How to get DATA from multiple tables at onece in ETL ???

Anonymous — Sat, 16 Nov 2024 14:10:16 GMT

Hi
I have 3 tables I need to get data out
lets call them pets, store, food (just an example)
I just want to get all the data from those tables, but with a join, mean that if pets have "petID" and so does store, than it will bring it and not show "petID" twice (you get my point, a usually join)
When I use the "tMysqlInput" I can choose more than one table (even 10 or more) at the Query design.
So there it works ok.
BUT
I need to choose table name for it, and there is more than one table.
Also,
I need to define "schema" for it, and need to id manually (not that good) and when I pass it to something like a "logger"
It doesn't work
Can someone please assist me here ?
Thank you.

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Wed, 05 Nov 2008 14:04:03 GMT

If you don't use the Guess Query button you don't have to specify the right table name.
To create the schema you can try to use the guess schema button the if it doesn't work you can create it manually
cheers

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Wed, 05 Nov 2008 16:26:57 GMT

amm I have tried, but getting problems
Seem like the data isn't right
and why can't I just AUTO create the schema? just like when selecting one table and let it guess the sql for it ??
Thank you!!

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Wed, 05 Nov 2008 20:47:16 GMT

Anyone ???

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Thu, 06 Nov 2008 09:10:37 GMT

hi,
i'm not sure to correctly understand,
just put all your tables you need and connect them by a TMAP. One tmysqlinput by table.
You can use db connection in metadata an retrieve the schema for you tables.
After you can drag your table in your job, qry and schema are auto define.

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Thu, 06 Nov 2008 09:46:43 GMT

Can you explain more about it please?
I have my tables, and defined the scehma for them (auto one)
Than, how can I use them all? means, I don't want just to get the data, but do some kind of join
Here is a example
If I have 3 tables
cars, date, people
people has both the car key and the date key
so I want to get all the cars to a someone on the date
Something like a join, but with more than two tables.
Just getting all the data, but having it on each row with the needed data that is sutible for the keys

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Thu, 06 Nov 2008 18:40:01 GMT

hi,
did you have read the user guide?
The component TMAP is for your need

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Thu, 06 Nov 2008 19:46:39 GMT

I have read it!
Still don't understand
Lets say I want to get data out of 5 different tables
But, I don't just want to "take" all the data, but do somekind of JOIN, means that if table A and B has a common key like ID, it will use it.
How can this be done please?

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 06:52:16 GMT

anyone?

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 08:48:14 GMT

link your 5 tables to the tmap.
In the tmap, link your table on their key.
just drop the field you want on the right side of the TMAP

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 08:52:46 GMT

Ok, so I will make 5 SQL input compents for reading the tables
Right?
And than to the TMAP
But, on the tamp, I have one as the main, and the others as "lookup" tables
And I want to get all the fiels, but with some kind of join
Like if table 1 and 2 and 3 have ID, than it will make sure that each row is a join of those ID's
How can it be done?

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 13:15:33 GMT

you join table1 to table2, table2 to table3...

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 13:17:41 GMT

And than?
I want to join them all, means all the 5 to one table

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 14:21:46 GMT

Yes you must do this

jeremie

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 14:24:25 GMT

Do what?
5 joins?!
Isn't there a simpler way?
how will you do it?
Can you please upload a photo or something please ?

Re: How to get DATA from multiple tables at onece in ETL ???

Anonymous — Fri, 07 Nov 2008 22:08:09 GMT

Hello Everone,
I need a advise on this issue.
I am building a data conversion job, where i need to look up using different built in queries from multiple tables(4)(using oracle input components - toracleInput) and validate that data on data in flat file, which i could do on the tmap component using relevant join operations, but my issue is the lookups run before the main flow from CSV componet starts, can any one help me on how i can make the lookups run for each iteration/row of the data from the main flow (flat file - tFileInputDelimited component)
my thanks in advance
Madhu