Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
See why IDC MarketScape names Qlik a 2025 Leader! Read more
cancel
Showing results for 
Search instead for 
Did you mean: 
mani1304
Creator
Creator

Generic Job

Hi All,

I am new to Talend wand want to create a generic job, where I need to provide table name from context file and it will generate schema for the table and fetch the data accordingly.

e.g. "select * from context.table_name"

Thanks in Advance.

 

Labels (2)
4 Replies
Anonymous
Not applicable

What is the full requirement for this job and what will happen with the data (where will it go)? Depending on your requirement, this might be possible....but if you expect Talend to understand the data and do something with it between the source and target, I think this may be quite difficult. The enterprise edition has a generic schema (which would make this easier), but the open source product will require a bit more work.

shrikavi2008
Contributor
Contributor

Hi,

Are you going to maintain list tables in a context file ? If So, what will be the context name for each table ?  Please confirm on this.

 

You can use Dynamic Schema for the generic job, but there are some limitation - dynamic schema feature available only in Enterprise edition, and the transformation is bit complex)

Anonymous
Not applicable

@mani1304 

 

Could you please try the below method? Of course the current requirements specified in your post is quite broad. So you may have to make amendments based on your need.

 

https://community.talend.com/t5/Design-and-Development/Dynamic-ingestion-of-data-to-an-Oracle-databa...

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

mani1304
Creator
Creator
Author

Hi, 

I want to have a context file having all the table names(one by one) and I want that when I am fetching data from tdbinput, instead of giving table name.

I will provide that context file and from that context file, it will get all the tables(one by one) and it should fetch the data accordingly into output files(one by one).

One method, I got that I will use tfilelist component and here I can mention all the files having the queries, then tfileinputdelimited will get the files and tflowiterate will outflow the output one by one and pass to tdbinput component and it has schema type as dynamic and db type as varchar, it is fetching the data, but I want table name should be pass through context file and it should process accordingly, hope this would be clear and share your thoughts.