topic Re: Using tReplicate with tUnite in Talend Studio

Using tReplicate with tUnite

Anonymous — Sat, 16 Nov 2024 05:44:15 GMT

Hi,

I need to split a dataset using tReplicate and then rejoin them using tUnite. I've seen that Talend doesn't allow this in a SubJob so I thought I could try separating them by using the tReplicate in one Subjob & then using tUnite in another Subjob.

I can get them to connect but I wondered why this job isn't running?

The below snapshot of my Job shows the components starting at the 2 tMaps that split address types, then the duplicates are removed, I then wanted to end the Subjobs there before I use the tBufferInput components and then append the data using the tUnite component.

The error I get at the second tBufferInput (After the OnComponentOk) is "A component that is not a subprocess start can not have any link on component ok / on component error in input".

I think this refers to the same issue but I'm not sure.

My question is, can I use a second subjob to allow the rejoining of my 2 datasets using this method, or is there another way?

Thanks

Re: Using tReplicate with tUnite

TRF — Mon, 27 May 2019 11:12:42 GMT

You can't join 2 flows which have been separated in the same flow and you cannot have mode than 1 starting component for the same subjob.

Consider the following design instead of yours:

Re: Using tReplicate with tUnite

Anonymous — Mon, 27 May 2019 11:29:27 GMT

Thanks TRF,

Could you explain the steps you've taken in order so I can follow your Job?

I haven't used HashInput yet & I don't get how they work in a Job.

Thanks

Re: Using tReplicate with tUnite

TRF — Mon, 27 May 2019 13:15:42 GMT

tHashOutput allow you to have records in memory and tHashInput are used to read these records.

A tHashInput is linked to the tHashOutput of your choice.

You just have to copy manually the schema from the tHashOutput to the tHashInput and that's all.

In your case tHashOutput components must be placed after tUniq components.

The right part of your job must be redesigned as proposed in my example.

Re: Using tReplicate with tUnite

Anonymous — Tue, 28 May 2019 02:23:05 GMT

Thanks TRF,

I'll give it a go.

Cheers