topic Dynamic schema script for loading data from file to Database table in Talend Studio

Dynamic schema script for loading data from file to Database table

Anonymous — Sat, 16 Nov 2024 07:22:23 GMT

I have a scenario where I need to dynamically load data from csv file into Database table. When ever new columns gets added in Flat file it should dynamically reads the data from the flat file and load into MySQL database table and also I need script in tjavarow to run this scenario

please help with some option.

Thanks!!

Re: Dynamic schema script for loading data from file to Database table

Anonymous — Thu, 01 Nov 2018 06:07:44 GMT

Hi Vidya,

You will not be able to modify the schema structure of DB components (like MySQL) on the fly. But another approach is to store the metadata information separately and parse the data based on the metadata.

Could you please refer below Talend blog for details?

https://www.talend.com/blog/2016/03/11/how-to-operationalize-meta-data-in-talend-with-dynamic-schemas/

Warm Regards,

Nikhil Thampi

Re: Dynamic schema script for loading data from file to Database table

Anonymous — Thu, 01 Nov 2018 06:28:10 GMT

Hi Nikhilthampi,

Can you please elaborate me with some more example and components to be used for this dynamic schema??

Re: Dynamic schema script for loading data from file to Database table

Anonymous — Thu, 01 Nov 2018 06:53:36 GMT

Hi,

Please refer the below blogs and community posts which is having details related to this topic.

https://community.talend.com/t5/Design-and-Development/tMap-with-Dynamic-schema/td-p/43409

https://community.talend.com/t5/Design-and-Development/resolved-I-want-to-create-a-generic-talend-job-with-dynamic/td-p/186404

http://edwardost.github.io/talend/di/2015/07/19/dynamic-mapping/

If the reply has helped to resolve your query, could you please mark the topic as closed? Kudos are also welcome 🙂

Warm Regards,

Nikhil Thampi