Read multiple types of files dynamically

gtaware — Fri, 17 Jan 2020 02:14:20 GMT

Hi All Experts ,

I have below requirement ,

1) I have having a directory which contain multiple CSV ,fixed length and xml files .

2) I am also having 3 template in JSON file for above files which contains schema related information

Template for CSV : This will contain filed names ,field Identifier, filed separator , field position

Template for Fixed Length : This will contain filed names , filed separator , field position , field length

Template for XML : This will contain field name and xpath

Now I am also having one more template in Table which will contain filename , file type , directory name ...etc information .

I want to design a job which will read a data from table and based on filetype it will read respective files using respective template and the also update status of file into another table ( example status="Processed" )

I gone through community discussion but did not find relevant information for this . Can you please provide me any design which has already build for the same .

Re: Read multiple types of files dynamically

fdenis — Fri, 17 Jan 2020 07:44:39 GMT

you can create a job by file type to extract data as dynamic (enterprise version only) type then convert dynamic type to structered row and work.

Regards

topic Read multiple types of files dynamically in Talend Studio

Read multiple types of files dynamically

Re: Read multiple types of files dynamically