Tmap Large Lookup

[Prasanna3]

Hi Team,

I am doing Lookup with 2 crores data .

What are the points needs to consider to improve performance?

Can someone please suggest me solution

[Prasanna3]

I want all the records from the main Flow but from the lookup I just needed to find out the main Flow date between lookup. Start and end date keys for the matched PID if matched then need to update status in tmap output

[manodwhb]

Based on your last screen shot you have duplicates from main flow also. When you have duplicates the no of records will increase.

[Prasanna3]

I have 1 crore data is it good option to store data into thashoutput and tbufferoutput for further processing.

Can you please suggeste maximum how much data we can store in hashcomponents to get better performance?

[manodwhb]

tHashoutput store the data on RAM,so based on your RAM you have see is it working.

[Prasanna3]

I have two subjobs

In first job I am strong data in thashoutput
After first subjob completed then job got failed and job exited in that case thashoutput data will be cleaned or still exist in the memory

[manodwhb]

If you used with in the job it will be available in memory which you can read using thashinput.

You can not use the way in different sub jobs.

[Prasanna3]

I am using thashinput in different subjob

[manodwhb]

Which will not able to get the data right?