topic Unloading data from multiple tables in Talend Studio

Unloading data from multiple tables

rajesh90 — Wed, 26 Oct 2016 09:44:40 GMT

Team,

I'm new to Talend Data Integration, currently I have a requirement to unload data from 50 Oracle source tables.
So i'm looking forward to build a generic process to unload the tables, instead of using multiple tOracleInput component.
Kindly help me on this requirement.

Regards,
Rajesh

Re: Unloading data from multiple tables

Anonymous — Thu, 27 Oct 2016 03:25:22 GMT

Hi,
Here is a dynamic schema feature. It allows you to design schema with an unknown column structure (unknown name and number of columns).
Note: Dynamic schema feature is only available in Talend Subscription Solution.
Please take a look at KB article about:TalendHelpCenter:How to process changing data structure?
Best regards
Sabrina

Re: Unloading data from multiple tables

rajesh90 — Thu, 27 Oct 2016 13:07:06 GMT

Hi Sabrina,

I understood the idea by reading through the article.
But my question here is how to unload the 50 tables one by one, or parallel through the tOracleInput component.
Because to put 50 tOracleInput components in a single job to unload data, will be a bad idea.

Re: Unloading data from multiple tables

Anonymous — Fri, 28 Oct 2016 09:29:09 GMT

Hi,
You can read the tables names from a flat file or a DB tables.
The tFlowtoIterate component can loop them. It will give you a globalMap variable which you can use in the table load logic.
In addition, tcontextload or implicit tcontextload is also used to load a context from a flow.
Best regards
Sabrina