Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Job template & dynamic table structure

Hello all,

 

We have to create several job doing exactly the same thing, but with differents input/output table.

 

The job will run as follow:

  1. Get an ID (LoadID) from an API;
  2. Get data on an input table;
  3. Insert these data, including the LoadID, on an output table (the field wich will contain the LoadID exists in all of the output table);
  4. Approve the insert via an API call;

 

We need to create 5 or 6 times this job, with a different input and output table. To me, the best practice would be to create a "generic job", passing input and output table as parameters to the job.

 

The problem is these input/output table don't have the same data structure.

 

Does anybody have an idea on how to dynamically specify the table structures?

 

Thanks in advance for your help,

 

Talend version: Talend Data Integration v6.3.1

Database type: Postgresql (> v10)

Labels (2)
1 Reply
Anonymous
Not applicable
Author

Hello,

Talend Dynamic schema feature will allow you to design schema with an unknown column structure (unknown name and number of columns).

Could you please let us know if this article helps?

https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/2...

Best regards

Sabrina