Qlik Community

New to Qlik Sense

Discussion board where members can get started with Qlik Sense.

Announcements
Qlik® Product Spotlight: Discover what’s possible. Get more from our products.
See for yourself. Register today.
Not applicable

ODBC taking lot of time to load data

Hi,

I am facing issue in data load in qliksense. Its taking 1hr to just load around 100k records. My database is oracle.

Data is generally in millions, with speed of 100k per hour it would be too slow.

Please suggest how to improve data load speed.

3 Replies
vinieme12
Esteemed Contributor II

Re: ODBC taking lot of time to load data

There many things to consider

1) where is the database server located? If it is overseas then thus is expected!!

2) Is the DB server busy with other jobs and has allocated less resource for your query or has the DBA restricted the resource for your user group.

3) In a table of millions of records the more the number of filters in your where clause the longer it takes to  retrieve the data, try reducing the filters in your sql statement.

4)Your Network speed

5) The amount of ram on your machine

6) If you are querying a VIEW instead of a TABLE then note that a view will rebuild everytime you query it which adds to the processing time, try to create a static table and query that Table instead and have the table refreshed overnight or weekly as needed.

MVP & Luminary
MVP & Luminary

Re: ODBC taking lot of time to load data

Beside the considerations mentioned from Vineeth try it with an OLEDB driver which should be provide more performance.

- Marcus

rohitk1609
Valued Contributor II

Re: ODBC taking lot of time to load data

HI Akansha,

As what information you added, anyone can add solution with basic information , I don't think these type of answer is enough to fix your problem, Please provide us information in more detail and first contact to your DB Administrator , ask the data base configuration, fetching data is no less than downloading data.