Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I am unable to configure Talend to process multiple files. I have a job that transforms TXT files to HL7 files and that part of the job is working.
I am trying to iterate on a folder with multiple TXT files to transform them to HL7. I am using tFileList as the component to provide this function. There are 10 TXT files to be process in the source directory.
When I run the job, only the last of the 10 txt files is transformed.
Please help!!!
I am trying to iterate on a folder with multiple TXT files to transform them to HL7. I am using tFileList as the component to provide this function. There are 10 TXT files to be process in the source directory.
When I run the job, only the last of the 10 txt files is transformed.
Please help!!!
1 Solution
Accepted Solutions
Hello everyone,
I was able to develop a workaround regarding the issue of not being able to iterate on a multiple source files and transform and save to multiple HL7 files. It seems there is an issue with the tHL7output component and it does not allow to iterate on a source directory. what happens is only the last source file is transformed. When using tFileOutputDelimited component, the source directory iteration works as expected.
So, because the tHL7output component has a bug, I developed a different was to iterate on the source directory that allows multiple HL7 files to be created based on the number of source files. The parent job gets the source data from a SP and then creates a separate file for each row returned. The child job iterates on the source directory and creates an HL7 file in the destination directory for each source file found. The job ends when source files have been processed.
I am going to spend the next few days evaluating the job to ensure stability and likely make other minor improvements which I'll post.
Happy to answer any questions...
I was able to develop a workaround regarding the issue of not being able to iterate on a multiple source files and transform and save to multiple HL7 files. It seems there is an issue with the tHL7output component and it does not allow to iterate on a source directory. what happens is only the last source file is transformed. When using tFileOutputDelimited component, the source directory iteration works as expected.
So, because the tHL7output component has a bug, I developed a different was to iterate on the source directory that allows multiple HL7 files to be created based on the number of source files. The parent job gets the source data from a SP and then creates a separate file for each row returned. The child job iterates on the source directory and creates an HL7 file in the destination directory for each source file found. The job ends when source files have been processed.
I am going to spend the next few days evaluating the job to ensure stability and likely make other minor improvements which I'll post.
Happy to answer any questions...
Hi Sabrina, just noticed I wasn't using your correct name. sorry about that.
On a hunch a split the 3 segments of the HL7 (MSH, EVN, PID) to 3 tmap inputs. I was hoping that was the problem but unfortunately the results are the same.
Please let me know what other information I can provide. I can post the job as well if you'd like to have a look at it.
Thank you
On a hunch a split the 3 segments of the HL7 (MSH, EVN, PID) to 3 tmap inputs. I was hoping that was the problem but unfortunately the results are the same.
Please let me know what other information I can provide. I can post the job as well if you'd like to have a look at it.
Thank you
Hi Sabrina,
I made the changes to the job as requested but the results are the same. I've posted an image of the job. The image is called "OnSubJobOK_Example".
I set the 'Append' bit as well. I've also tried both UTF-8 and ISO-8859-15 as encoding types but that did not do anything different. I don't know if that has anything to do with it but was the one thing I've not changed.
Please let me know if I can post the job somewhere for you to have a closer look at it.
I'm desperate!!!
Thanks!
I made the changes to the job as requested but the results are the same. I've posted an image of the job. The image is called "OnSubJobOK_Example".
I set the 'Append' bit as well. I've also tried both UTF-8 and ISO-8859-15 as encoding types but that did not do anything different. I don't know if that has anything to do with it but was the one thing I've not changed.
Please let me know if I can post the job somewhere for you to have a closer look at it.
I'm desperate!!!
Thanks!