Skip to main content
Announcements
SYSTEM MAINTENANCE: Thurs., Sept. 19, 1 AM ET, Platform will be unavailable for approx. 60 minutes.
cancel
Showing results for 
Search instead for 
Did you mean: 
mani1304
Creator
Creator

Dynamic Schema for multiple schema files

Hi All,

I have 3 set of files(2 csv file and one .txt file) with different schemas in a location and I need to fetch last 7 days files, currently I am fetching them using tFilelist then tinputfiledelimted in 3 flows, can I do it one using dynamic schema or some other way?

Labels (3)
5 Replies
Anonymous
Not applicable

Hello,

The dynamic schema allows you to design Jobs with an unknown column structure (unknown name and number of columns).

Please have a look at this KB article about:

https://community.talend.com/s/article/How-to-process-changing-data-structure-ExK7j

Best regards

Sabrina

mani1304
Creator
Creator
Author

Thanks Sabrina, Is there any other way to handle it?

 

Anonymous
Not applicable

Hello,

Without using dynamic schema, you have to use 3 subjobs/flows to fetch 3 set of files(2 csv file and one .txt file) with different schemas.

Best ergards

Sabrina

 

mani1304
Creator
Creator
Author

Sorry, I didn't get it; Are you saying that it can be achieved by dynamic schema, how?

Anonymous
Not applicable

Hello,

It can be achieved by dynamic schema with one flow.

The work flow looks like:

tfilelist(fetch 3 set of files, *.csv and .*txt)-->tfileinputdelimited(dynamic schema)-->output

Feel free to correct us if we misunderstand your requirement.

Best regards

Sabrina