Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
anonymousmater
Contributor
Contributor
‎2023-08-22 04:08 AM

Performance Improvement for multiple lookup tables

Hi,

I am using the Talend Open Studio Data Integration (TOS_DI) v8.0.1 and have created the job below.

0695b00000nREyPAAW.png

Is there anything that can be done to improve the performance for the job?

Are there any multithreading that can be done on the lookup tables to allow faster data integration?

Labels (2)
Labels
176 Views
0 Likes
1 Reply
jeoste
Creator
Creator
‎2024-02-05 06:03 AM

Hello,

The best things you can do first is to separate this job, if impossible, into many other subjobs.

Lookup in Talend means you'll charge the entire result of the query into java ram, so if you have huge amount of data or a lot of lookup the job will crash before launching.

If you can't separate this job into many, then you should consider rework the job and create the join in SQL instead of using Talend

170 Views
0 Likes