Multiple Reject Files for each input file

SupItzAdeem — Tue, 06 Aug 2024 18:15:38 GMT

Hey guys, I made a job where it takes in multiple files of donation entries based on volunteers and sorts through them and inserts them into my database and outputs the rejects into a file. I'm having trouble getting it to make a seperate file for each volunteer's reject entries

This is how my job looks like and so far:

I have it mapped to a single csv file. I'm not sure how I would get it to make multiple files based on the volunteers since in the database the volunteers have a group leader id which is set to 100, 200, 300, ..., etc. and each group leader has volunteers with their own volunteer ids. For group leader id 100 it would range from (141 - 149), group leader 200 would be from 241-249.

Re: Multiple Reject Files for each input file

quentin-vigne — Fri, 09 Aug 2024 09:17:32 GMT

Hi SupItzAdeem

One idea is to add a tLoop component for each group leader from 100 to XXX with a step of 100

And add a tFilterRow for this value to only load the values of your file for the current value of the loop

And the file of for the rejects you can name it "C:/....../rejects_"+tLoopCurrentValue+".csv"

That's juste one idea of how to implement it

topic Multiple Reject Files for each input file in Talend Studio

Multiple Reject Files for each input file

Re: Multiple Reject Files for each input file