Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik and ServiceNow Partner to Bring Trusted Enterprise Context into AI-Powered Workflows. Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
js_support
Contributor
Contributor

ETL Job performance

Hello,

 

I'm in the process of migrating out ETL jobs from ODI (Oracle Data Integrator) to Talend. We finally have Talend installed and a Jobserver set up and are doing some testing. Initial testing is showing performance in our current setup in ODI is twice as fast as Talend. The "jobserver" specifications are the same in Talend and ODI and they are accessing the same databases. We have 16gb memory on both Talend and ODI jobservers. Any performance tuning we can do to get Talend to match our ODI performance? Attached is one of the jobs that is slow.

Labels (2)
2 Replies
js_support
Contributor
Contributor
Author

Any ideas here are much appreciated.

Anonymous
Not applicable

Hello,

What's your row rate per second?

In your work flow, tMap is a cache component consuming two much memory. Have you tried to try to store the data on disk instead of memory?

In the "advanced settings" tab of the tOracleInput component, did you check "Use cursor" option ? If not do it and try to play with the cursor size until you find which is best value for you.

Best regards

Sabrina