Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Posting on Qlik Community is temporarily paused for some users. Thank you for patience and we'll update you soon!
cancel
Showing results for 
Search instead for 
Did you mean: 
quriouss
Creator III
Creator III

Why is Oracle extract so slow?

I'm extracting a table from Oracle - 2.2 million rows, 10 columns, and the extract/load job in Qlik Sense took over 8 hours.

Using the Oracle SQL Developer tool, I downloaded the same data into a csv file in under 30 minutes, then loaded it into Qlik Sense in less than a minute.

Is there a page of tips to speed up the Qlik-Oracle connection? (ODBC via a 64-bit system DSN).

(I think I can probably get away with a single one-off load followed by daily differential loads, but it would be good to have an answer on hand).

20 Replies
greenee
Contributor III
Contributor III

I know it's an old post, but having similar issues with 19c now.

Having gone form 11g, to 18c, (very slow) and now have to move to 19c for security issues.

I have found also in the OLEDB connect string, adding fetch size and change extended properties to Encrypt=Yes, after the data source, speeds up DB extracts by at least a factor of x2 sometimes x5.
Hitting a table with 450m rows, Extracting 10m rows with where clause is now taking 5 mins.  🙂  compared to 1 hour with 18c. QV v12.8 2017, Oracle 19c drivers, (dont' forget to change the Environment variables for TNS_ADMIN to new directory, and also change the registry settings for Oracle home.

Data Source=XXXXXXXXXXX;FetchSize=5000; Extended Properties="ENCRYPT=YES"] 
I have tried with various fetch sizes (10k, 50k,100k etc) and this is the sweet spot for me.

(  Where normally Extended Properties=""]   )

Hope it helps someone.

Greenee