topic Two tmap using same i/p in Talend Studio

Two tmap using same i/p

Anonymous — Fri, 01 Feb 2019 19:00:45 GMT

I am using two i/p file(txt) to two different tmaps in same job.

In first case file a.txt is being main file for tmap 1 and file b.txt as lookup file.

In the same job above i/p s are exchanging and file a.txt is being used as lookup and b.txt is being used as main file to tmap 2.

I am trying to use replicate to replicate the sources records,job is running but not reading /writing.

Attached is the snapshot of job.

Please advise what is the issue/or any other suggestion/component i need to use.

Re: Two tmap using same i/p

Anonymous — Fri, 01 Feb 2019 20:33:20 GMT

You should try using the tHashInput and tHashOutput components for this. Read from each of your files into tHashOutput components (1 for each). These store the data in memory. Then using a tHashInput component for each of your 4 inputs to your tMap components. The tHashInput components can be used more than once. This way you read once and have more control over how the data is used.

Re: Two tmap using same i/p

vapukov — Sun, 03 Feb 2019 23:08:49 GMT

in addition to @rhall

if files too big to store them in memory - read them twice (do not use tReplicate)

run first subjob, than run second