Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I have 3 set of files(2 csv file and one .txt file) with different schemas in a location and I need to fetch last 7 days files, currently I am fetching them using tFilelist then tinputfiledelimted in 3 flows, can I do it one using dynamic schema or some other way?
Hello,
The dynamic schema allows you to design Jobs with an unknown column structure (unknown name and number of columns).
Please have a look at this KB article about:
https://community.talend.com/s/article/How-to-process-changing-data-structure-ExK7j
Best regards
Sabrina
Thanks Sabrina, Is there any other way to handle it?
Hello,
Without using dynamic schema, you have to use 3 subjobs/flows to fetch 3 set of files(2 csv file and one .txt file) with different schemas.
Best ergards
Sabrina
Sorry, I didn't get it; Are you saying that it can be achieved by dynamic schema, how?
Hello,
It can be achieved by dynamic schema with one flow.
The work flow looks like:
tfilelist(fetch 3 set of files, *.csv and .*txt)-->tfileinputdelimited(dynamic schema)-->output
Feel free to correct us if we misunderstand your requirement.
Best regards
Sabrina