topic Re: Multiple input `links merged in Talend Studio

Multiple input `links merged

Anonymous — Mon, 21 Aug 2017 13:02:39 GMT

Is there any component that allows records from multiple input links to merge (union) and pass out as one output link ? I tried using tUnite component but it does not accept links from loop flows.

My Job Flow:

File --> tmap (2 output links from tmap, this is for converting one row to two rows based on a constraint).

I need to merge these two links together, cant use tUnite, is there any other component that I can use for this purpose?

Re: Multiple input `links merged

Anonymous — Mon, 21 Aug 2017 13:35:07 GMT

Stick with a tUnite, you can convert a loop flows to a main flow using tIterateToFlow component.

Re: Multiple input `links merged

TRF — Mon, 21 Aug 2017 13:41:56 GMT

You need to store the 2 output into 2 separated tHashOutput, then, start a new subjob with a tHashInput (related to the 1rst tHashOutput) connected to a tUnite and connect the 2nd tHashinput (related to the 2nd tHashInput) to this tUnite.

Re: Multiple input `links merged

Anonymous — Tue, 22 Aug 2017 04:34:03 GMT

I am using Talend Open Studio for Big Data v6.3.1 edition & it doesnt have tHashOutput component, is there an alternative component for the same in this version

Re: Multiple input `links merged

Anonymous — Tue, 22 Aug 2017 04:38:13 GMT

Are you asking me to design a job like this:

InputOracle --> tMap --> One link to tUnite, another link to tIterateToFlow & then re-join with tUnite?

If Wrong, can you pl let me know the job design

Re: Multiple input `links merged

Anonymous — Tue, 22 Aug 2017 13:05:42 GMT

Can you provide a screenshot of your job? Where does your loop flow come from?

Re: Multiple input `links merged

TRF — Tue, 22 Aug 2017 14:11:22 GMT

I do not use TOS for Big Data but maybe it's like for DI, you have to enable thèse components before to use them.
In this case, go to File Menu-->Edit project properties-->PaletteSettings theb enable technical components family.

Re: Multiple input `links merged

Anonymous — Wed, 23 Aug 2017 03:25:28 GMT

I would suggest you follow the way @TRF has suggested. That is the only way you can unite 2 flows that have originated from the same main flow. Talend does not allow splitting of a flow and then merging back again into a single flow.

If you cannot get the t_Hash components enabled, then you can try out tFileoutput as well. t_Hash stores data in memory and tFileoutput will ask you to store it in a file. That is the only difference.

The flow would look something like below

File-->t_map-->output1-->tFileOutput_1
| |
| output2-->tFileOutput_2
|
OnsubJobOk
|
|
TFileInput_1----
|
t_Unite -->t_FileOutput_3
|
TFileInput_2----

Re: Multiple input `links merged

Anonymous — Wed, 23 Aug 2017 05:42:23 GMT

Thanks for your suggesstion. I had already tried this method, attached is the screenshot of my job.

So my subjob has the following components: tOracleInput -->t_map-->output1-->tFileOutput_1
| |
| output2-->tFileOutput_2
|

So this first subjob is over & that works fine independently.

When I give the links OnSubJobOK for the two Input files, I am able to connect one of the 1/P file to tUnite (thro Main link), while the other 1/P file doesnt get connected to tUnite.

Pl find the attached screenshot.

tUnite.jpg

Re: Multiple input `links merged

Anonymous — Wed, 23 Aug 2017 08:49:22 GMT

You do not need to have 2 onSubJobOK links. Just have one. the other tFileInput can remain floating and it will still work as long as it is connected to tUnite. refer to the job design I put before...for clarity refer below. Also, please share the error that you see in tUnite (I see a red mark there).

onSubJobOK

tFileInput_1----

t_Unite --> tFileOutPut_1

tFileInput_2---

Re: Multiple input `links merged

Anonymous — Wed, 23 Aug 2017 10:04:05 GMT

Thanks, it worked!