Skip to main content
Announcements
Qlik Introduces a New Era of Visualization! READ ALL ABOUT IT
cancel
Showing results for 
Search instead for 
Did you mean: 
anonymousmater
Contributor
Contributor

Performance Improvement for multiple lookup tables

Hi,

I am using the Talend Open Studio Data Integration (TOS_DI) v8.0.1 and have created the job below.

0695b00000nREyPAAW.png

Is there anything that can be done to improve the performance for the job?

Are there any multithreading that can be done on the lookup tables to allow faster data integration?

Labels (2)
1 Reply
jeoste
Creator
Creator

Hello,

The best things you can do first is to separate this job, if impossible, into many other subjobs.

Lookup in Talend means you'll charge the entire result of the query into java ram, so if you have huge amount of data or a lot of lookup the job will crash before launching.

If you can't separate this job into many, then you should consider rework the job and create the join in SQL instead of using Talend