topic Split then merge flow in Talend Studio

Split then merge flow

Anonymous — Sat, 16 Nov 2024 14:08:32 GMT

Hi,
I'm beginner with TOS and I would like to make a job which read a spreadsheet file,
made modification on data (based on database reference) by splitting the flow
and then merge two flow generated into one for the end of the process.
I use the tFilterRow componant to split the flow but I don't know what kind of componant to use to merge them.
I try tMap, tUnique, tJoin but without success for each of them.
Does anyone know how to simply merge two flow in Java project with TOS ?

I found a topic which explains how to make it but it's only for PERL project.
4792
Thx for your help.

Re: Split then merge flow

youssef2 — Fri, 28 Nov 2008 14:51:07 GMT

Hi,
it seems you're looking for the tUnit component. the flows you merge must have the same schema.
Regards,
Youssef

Re: Split then merge flow

Anonymous — Mon, 01 Dec 2008 17:56:05 GMT

tUnite is located under the Orchestration tab of the Palette.

Re: Split then merge flow

Anonymous — Tue, 02 Dec 2008 15:13:27 GMT

I try using tUnite but it doesn't work for me.
I verify I 've got the same schema for the two flow I want to merge.
I can link the first flow to the tUnite componant,
but when I want to link the second, it displays a forbidden icon and I can't link them.
I have uploaded a screenshot of my job.

Re: Split then merge flow

Anonymous — Wed, 03 Dec 2008 23:56:37 GMT

Currently, loop or cycle are not allowed in TOS.
Your tFilterRow_4 is the common source of data for the 2 branches of data.
HTH,

Re: Split then merge flow

Anonymous — Fri, 05 Dec 2008 09:20:49 GMT

Ok.
Can you explains me how to made what I want.
I have a flow and I want to split it with a filter to made specific action on lines filtered:
- lines filtered are inserted in database and I want to get the key associated (based on autoincrement column) to be added to the flow (new column in the schema)
- lines rejected are not used in a specific process but I have to modify the schema to add the new column described above with null value.
Then I want to merge lines filtered and lines rejected to have only one flow to continue the job for the rest of the process.
You tell me it's not possible with tUnite to merge the flow because of loop.
How can I made it ?
By using subjob ? But I think it's not possible to transmit a flow between job...

Re: Split then merge flow

Anonymous — Fri, 05 Dec 2008 11:41:17 GMT

If you use a tFilterRow, this is because you only want to keep some specific rows.
If you want to keep all the rows, then don't filter them....
If you really want to split your data, you can use socket component, or temp files in append mode.
And finally, You can use tBufferOutput to transmit a flow to the father job

Re: Split then merge flow

Anonymous — Fri, 05 Dec 2008 12:33:19 GMT

Ok.
Thanks for your interesting answers.
I try to use alternate solution you propose me.