topic Re: Taking much time to load data to a flat file from Oracle in Talend Studio

Taking much time to load data to a flat file from Oracle

Anonymous — Wed, 01 Nov 2017 10:52:01 GMT

Hi All,

I just installed Talend Open Studio 6.4.1 version in my local PC.
I want to transfer the data (around 6.8 Millions) from Oracle DB and writes to a flat file (around 2GB in size) without any transformations in between. I designed a job and running, it is taking much time to load. In Talend it is taking 30 mins to load 1 lakh records.
I need your expert advise how to improve performance and also please let me know if I am doing anything wrong.

Design:

toracleInput --> tFileOutputDelimeter

Thanks,
Basha

Re: Taking much time to load data to a flat file from Oracle

Anonymous — Wed, 01 Nov 2017 11:39:16 GMT

You can select 'Use cursor' check box and in the Cursor size field displayed, specify the number of rows to fetch in one go from the database.

Re: Taking much time to load data to a flat file from Oracle

Anonymous — Thu, 02 Nov 2017 05:40:36 GMT

Thanks for your answer. It helps me lot.

I have use Cusrsor set 50000 record , Now it finish 90 sec to complete 5 lakh records.

Can able to increase more data transfer?

Re: Taking much time to load data to a flat file from Oracle

Anonymous — Thu, 02 Nov 2017 05:45:15 GMT

Sure! You can increase it , until unless you are having me memory issues.