Using Same data to join in tmap

Anonymous — Fri, 04 May 2018 00:43:03 GMT

Hi,

I have a data source (Oracle Table) which I want to use to multiple times in my tMap. Since I have two different keys to join with the source that, is there any way I can use the same data flow twice?

I tried tReplicate, but it will not allow me to join the main flow twice to same tMap.

I tried to use a tMap after the table unload with two outputs and connect it to the tMap.

None of the solution looks to work.

Since this is a Dev environment the data volume in the below picture is less, but in Production it will be in Millions. Any assistance appreciated.

PS: I am new to Talend.

Re: Using Same data to join in tmap

vapukov — Fri, 04 May 2018 03:10:53 GMT

one of the possible solutions - use tHashInput / tHashOutput components, store once, use many

but it could use a lot of memory for big datasets.

other possible solutions, what could work better than database request - store results into local csv file, and re-use it when necessary.

third (depend from job logic) - relocate lookups on database side.

depending from design - each of this 3 ways could be the best choice.

topic Using Same data to join in tmap in Talend Studio

Using Same data to join in tmap

Re: Using Same data to join in tmap