Skip to main content
Announcements
SYSTEM MAINTENANCE: Thurs., Sept. 19, 1 AM ET, Platform will be unavailable for approx. 60 minutes.
cancel
Showing results for 
Search instead for 
Did you mean: 
gtaware
Contributor
Contributor

Read multiple types of files dynamically

Hi All Experts ,

I have below requirement ,

1) I have having a directory which contain multiple CSV ,fixed length and xml files . 

2) I am also having 3 template   in JSON file for above files which contains schema related information 

 

   Template for CSV : This will contain filed names ,field Identifier,  filed separator , field position 

   Template for Fixed Length :  This will contain filed names , filed separator , field position , field length 

 Template for XML : This will contain field name and xpath 

 

 

Now I am also having one more template in Table which will contain filename , file type , directory name ...etc information . 

 

I want to design a job which will read a data from table and based on filetype it will read respective files using respective template  and the also update status of file into another table ( example status="Processed" ) 

 

I gone through community discussion but did not find relevant information for this .  Can you please provide me any design which has already build for the same . 

 

Labels (3)
1 Reply
fdenis
Master
Master

you can create a job by file type to extract data as dynamic (enterprise version only) type then convert dynamic type to structered row and work.

Regards