[resolved] Not able to process multiple files using tFileList
I am unable to configure Talend to process multiple files. I have a job that transforms TXT files to HL7 files and that part of the job is working.
I am trying to iterate on a folder with multiple TXT files to transform them to HL7. I am using tFileList as the component to provide this function. There are 10 TXT files to be process in the source directory.
When I run the job, only the last of the 10 txt files is transformed.
Please help!!!
Hi Sabrina, the E-mail link below your avatar does not provide a way to attach a job. Would you provide more information on how to attach a job to send to you via email?
Thanks!
Hello everyone,
I was able to develop a workaround regarding the issue of not being able to iterate on a multiple source files and transform and save to multiple HL7 files. It seems there is an issue with the tHL7output component and it does not allow to iterate on a source directory. what happens is only the last source file is transformed. When using tFileOutputDelimited component, the source directory iteration works as expected.
So, because the tHL7output component has a bug, I developed a different was to iterate on the source directory that allows multiple HL7 files to be created based on the number of source files. The parent job gets the source data from a SP and then creates a separate file for each row returned. The child job iterates on the source directory and creates an HL7 file in the destination directory for each source file found. The job ends when source files have been processed.
I am going to spend the next few days evaluating the job to ensure stability and likely make other minor improvements which I'll post.
Happy to answer any questions...