Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi,
I am using the Talend Open Studio Data Integration (TOS_DI) v8.0.1 and have created the job below.
Is there anything that can be done to improve the performance for the job?
Are there any multithreading that can be done on the lookup tables to allow faster data integration?
Hello,
The best things you can do first is to separate this job, if impossible, into many other subjobs.
Lookup in Talend means you'll charge the entire result of the query into java ram, so if you have huge amount of data or a lot of lookup the job will crash before launching.
If you can't separate this job into many, then you should consider rework the job and create the join in SQL instead of using Talend