Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
anonymousmater
Contributor
Contributor
‎2023-08-22 04:08 AM

Performance Improvement for multiple lookup tables

Hi,

I am using the Talend Open Studio Data Integration (TOS_DI) v8.0.1 and have created the job below.

0695b00000nREyPAAW.png

Is there anything that can be done to improve the performance for the job?

Are there any multithreading that can be done on the lookup tables to allow faster data integration?

Labels (2)
Labels
555 Views
0 Likes
1 Reply
jeoste
Creator II
Creator II
‎2024-02-05 06:03 AM

Hello,

The best things you can do first is to separate this job, if impossible, into many other subjobs.

Lookup in Talend means you'll charge the entire result of the query into java ram, so if you have huge amount of data or a lot of lookup the job will crash before launching.

If you can't separate this job into many, then you should consider rework the job and create the join in SQL instead of using Talend

549 Views
0 Likes