topic Re: Merge data from multiple tMap components in Talend Studio

Merge data from multiple tMap components

vidya821 — Tue, 27 Jun 2017 10:02:35 GMT

Hi all,

How can i merge the data from multiple tMap components into single output file

PFA

Thanks

Re: Merge data from multiple tMap components

cterenzi — Tue, 27 Jun 2017 15:21:45 GMT

You can connect each filter to its own file output component, and configure the output components to reference the same file name. Check the "Append" box to make them all add to the file rather than overwrite it.

Re: Merge data from multiple tMap components

TRF — Wed, 28 Jun 2017 07:52:13 GMT

Depending on what you need to do after this step, you can also use tHashOutput to result from all the tMap in memory and reuse it later using tHashInput. This suppose the schema is the same for each output tMap, else you need to reconciliate first.

Re: Merge data from multiple tMap components

vidya821 — Thu, 29 Jun 2017 08:59:55 GMT

Thanks, i was able to manage it with tMap since schema was same for all outputs , using join in the different tMaps helped me to achieve the desired output

Re: Merge data from multiple tMap components

vidya821 — Thu, 29 Jun 2017 09:00:17 GMT

Thanks, i was able to manage it with tMap since schema was same for all outputs , using join in the different tMaps helped me to achieve the desired output without using filters

Re: Merge data from multiple tMap components

Anonymous — Wed, 05 Jul 2017 07:50:05 GMT

Hi,

Please take a look at this post:https://community.talend.com/t5/Troubleshooting-Development/Can-I-create-a-Job-with-multiple-paths-from-a-single-source-to/ta-p/21653.

Best regards

Sabrina

Re: Merge data from multiple tMap components

Anonymous — Mon, 30 Apr 2018 10:25:45 GMT

Hi,

I want to conduct an upsert logic for a flat file, i.e consider a StudentList which consists of Id, Name. Once, the data is inserted, next time, only a delta file would be provided which would consist of new rows, and rows with updates. Please note, there is no database involved. ONLY flat files. Should I implement this?

I tried creating a Tmap as given in the screenshot, and sent both the outputs NewRecord and UpdatedRow to different tFileOutputDelimited referencing the same output file but, it gets replaced, hence, not implementing the UPSERT logic.

Regards,

Princy

Tmap.JPG

Re: Merge data from multiple tMap components

Anonymous — Mon, 30 Apr 2018 10:25:48 GMT

Hi,

Regards,

Princy

Tmap.JPG
Tmap.JPG

Re: Merge data from multiple tMap components

vidya821 — Fri, 04 May 2018 08:26:31 GMT

Better approach would be
1) Read the flat file as a single file row instead of columns (The Tmap will compare the complete row data with lookup file row data and it would give you the difference data)
2) Use only one output with the tmap settings of Catch lokup inner join reject as true (Thus the new records and the updated records would be sent as output)

Thanks

Tmap_settings.png