topic Re: How to Optimize Job FLow with Multiple tMaps in Talend Studio

How to Optimize Job FLow with Multiple tMaps

Anonymous — Mon, 24 Sep 2018 11:45:36 GMT

Hi All,

I am developing a job in talend. And there are multiple tMaps used in this job like 3 tables's join in a tMap and the output of this tMap will be used further as Source and 3 more tables as Lookup and so on... And the output of this tMap will be used for further join.

this job become very large. i want a solution so that i can improve the design. Please suggest me.

I also thought about child parent job mechanism but all tmap's output is dependent on lookup tables.

Thanks in advance

Re: How to Optimize Job FLow with Multiple tMaps

Anonymous — Mon, 24 Sep 2018 11:51:50 GMT

This is the screenshot of jobflow.

Please provide some solution

Untitled.png

Re: How to Optimize Job FLow with Multiple tMaps

Anonymous — Mon, 24 Sep 2018 12:43:24 GMT

Are the tables you are querying in the same database? If so, join in the SQL query. That will improve the efficiency of the job and will make it look far less busy.

Re: How to Optimize Job FLow with Multiple tMaps

Anonymous — Wed, 26 Sep 2018 06:37:18 GMT

Thanks for your reply !

Actually, There are other services also run on database server. So i can not perform operation on database side. Because these tables have millions of records.