Job template & dynamic table structure

Anonymous — Tue, 08 Jan 2019 10:45:12 GMT

Hello all,

We have to create several job doing exactly the same thing, but with differents input/output table.

The job will run as follow:

Get an ID (LoadID) from an API;
Get data on an input table;
Insert these data, including the LoadID, on an output table (the field wich will contain the LoadID exists in all of the output table);
Approve the insert via an API call;

We need to create 5 or 6 times this job, with a different input and output table. To me, the best practice would be to create a "generic job", passing input and output table as parameters to the job.

The problem is these input/output table don't have the same data structure.

Does anybody have an idea on how to dynamically specify the table structures?

Thanks in advance for your help,

Talend version: Talend Data Integration v6.3.1

Database type: Postgresql (> v10)

Re: Job template & dynamic table structure

Anonymous — Tue, 15 Jan 2019 09:02:38 GMT

Hello,

Talend Dynamic schema feature will allow you to design schema with an unknown column structure (unknown name and number of columns).

Could you please let us know if this article helps?

https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/21702

Best regards

Sabrina

topic Re: Job template & dynamic table structure in Talend Studio

Job template & dynamic table structure

Re: Job template & dynamic table structure