topic Re: Dynamic Schema for multiple schema files in Talend Studio

Dynamic Schema for multiple schema files

mani1304 — Fri, 15 Nov 2024 23:27:09 GMT

Hi All,

I have 3 set of files(2 csv file and one .txt file) with different schemas in a location and I need to fetch last 7 days files, currently I am fetching them using tFilelist then tinputfiledelimted in 3 flows, can I do it one using dynamic schema or some other way?

Re: Dynamic Schema for multiple schema files

Anonymous — Fri, 03 Dec 2021 08:06:41 GMT

Hello,

The dynamic schema allows you to design Jobs with an unknown column structure (unknown name and number of columns).

Please have a look at this KB article about:

https://community.talend.com/s/article/How-to-process-changing-data-structure-ExK7j

Best regards

Sabrina

Re: Dynamic Schema for multiple schema files

mani1304 — Sun, 05 Dec 2021 10:06:52 GMT

Thanks Sabrina, Is there any other way to handle it?

Re: Dynamic Schema for multiple schema files

Anonymous — Mon, 06 Dec 2021 08:03:21 GMT

Hello,

Without using dynamic schema, you have to use 3 subjobs/flows to fetch 3 set of files(2 csv file and one .txt file) with different schemas.

Best ergards

Sabrina

Re: Dynamic Schema for multiple schema files

mani1304 — Tue, 07 Dec 2021 17:39:21 GMT

Sorry, I didn't get it; Are you saying that it can be achieved by dynamic schema, how?

Re: Dynamic Schema for multiple schema files

Anonymous — Wed, 08 Dec 2021 05:41:04 GMT

Hello,

It can be achieved by dynamic schema with one flow.

The work flow looks like:

tfilelist(fetch 3 set of files, *.csv and .*txt)-->tfileinputdelimited(dynamic schema)-->output

Feel free to correct us if we misunderstand your requirement.

Best regards

Sabrina