Skip to main content
Announcements
Discover what’s possible with embedded analytics! March 6, 10 AM ET SIGN UP!
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

SQL table taking too long to store into QVD


Hi,

I have two huge sql tables with Table1 has 4213039 rows

and Table2 has 12710440 rows

when I am loading the tables into QVDs by using

Store Table1 into C:\qlikviewpath\Table1.qvd;

Store Table2 into C:\qlikviewpath\Table2.qvd;

to load the scrit execution is taking more than 14 minutes. could anyone let me know is there anyway to load data into QVD very fast.

Thanks.

27 Replies
Not applicable
Author

Hello,

Probably you should optimize your query to last shorter. The row counts you mentioned are not really huge. If you have WHERE criteria in your query check if these columns have indexes.

Also if any part of your data will not be updated in the future, you could use Incremental Loading. Just store the whole table for once in a qvd file and then add the new parts to the old qvd file. This will significantly optimize your process.

Best.

Not applicable
Author

Thanks. There is no indexes in the tables. and I have data migration so the table is updated. so, in this case how can I choose very fast load. could let me know please.

Not applicable
Author

After writing the query run the estimated query plan -if you are using MS SQL. It will show you -if needed- a suggested index in a green line with the impact rate. You can right click to that suggestion to show missing index details and run the suggested index command.

Clever_Anjos
Employee
Employee

How many megabytes thats qvds are using?

Not applicable
Author

One Qvd is 1.52 GB and another Qvd is 546 MB

flipside
Partner - Specialist II
Partner - Specialist II

Hi Amelia,

Is it the loading of data from SQL to Qlikview that's taking a long time, or the writing of the data from Qlikview to QVD?

flipside

Not applicable
Author

Hi,

Both are taking too long. Any help please.

thanks.

dmohanty
Partner - Specialist
Partner - Specialist

  • First Check how much time its taking to fetch the data from Database when executing in your Tool (Toad, SQLAssistant,QMF whatever)
  • If you have '*' like this : SELECT * from Table1, replace star with all column names.
  • Check if are using GROUPBY properly if you are using it.

If else post your sample query, lets see to optimise!!!

Clever_Anjos
Employee
Employee

I my humble opinion they´re are too big.

We have a 'golden rule' here that no qvd can be more than 100 Mb.

Is there any field that you can use to split your files? (Maybe a month)