Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Share your agentic AI experience, learn from others, and earn a new badge: Put Agentic AI to Work
cancel
Showing results for 
Search instead for 
Did you mean: 
PS1656525765
Contributor
Contributor

How to do SCD1 for dynamic data type in talend

Hi All,

​

I have a scenario where i am getting around 200 feed files from ​source system. All the files are having different metadata.I need to insert records that are not available in MS SQL database and i need to update records that are already available in MS SQL database based on key.I need to create one job to automate this process for all files.

​

Did anyone solved this kind of scenario?

​

Need help for this problem..

​

Note: I am using talend subscription based product .I can create 200 jobs for 200 ​files but it will create a complexity for me in future files count can increase upto 400..

​

​

​

​

​

1 Solution

Accepted Solutions
gjeremy1617088143
Master
Master

Hi @Prabhakar Sudha​ , as you are using a Talend subscribed product you can check if dynamic schema can help you in this task .

https://help.talend.com/r/en-US/8.0/studio-user-guide-big-data/dynamic-schema

View solution in original post

1 Reply
gjeremy1617088143
Master
Master

Hi @Prabhakar Sudha​ , as you are using a Talend subscribed product you can check if dynamic schema can help you in this task .

https://help.talend.com/r/en-US/8.0/studio-user-guide-big-data/dynamic-schema