SQL table taking too long to store into QVD

[#1]

Hi,

I have two huge sql tables with Table1 has 4213039 rows

and Table2 has 12710440 rows

when I am loading the tables into QVDs by using

Store Table1 into C:\qlikviewpath\Table1.qvd;

Store Table2 into C:\qlikviewpath\Table2.qvd;

to load the scrit execution is taking more than 14 minutes. could anyone let me know is there anyway to load data into QVD very fast.

Thanks.

[#2]

Hello,

Probably you should optimize your query to last shorter. The row counts you mentioned are not really huge. If you have WHERE criteria in your query check if these columns have indexes.

Also if any part of your data will not be updated in the future, you could use Incremental Loading. Just store the whole table for once in a qvd file and then add the new parts to the old qvd file. This will significantly optimize your process.

Best.

[#3]

Thanks. There is no indexes in the tables. and I have data migration so the table is updated. so, in this case how can I choose very fast load. could let me know please.

[#4]

After writing the query run the estimated query plan -if you are using MS SQL. It will show you -if needed- a suggested index in a green line with the impact rate. You can right click to that suggestion to show missing index details and run the suggested index command.

[Clever_Anjos]

How many megabytes thats qvds are using?

[#6]

One Qvd is 1.52 GB and another Qvd is 546 MB

[flipside]

Hi Amelia,

Is it the loading of data from SQL to Qlikview that's taking a long time, or the writing of the data from Qlikview to QVD?

flipside

[#8]

Hi,

Both are taking too long. Any help please.

thanks.

[dmohanty]

• First Check how much time its taking to fetch the data from Database when executing in your Tool (Toad, SQLAssistant,QMF whatever)
• If you have '*' like this : SELECT * from Table1, replace star with all column names.
• Check if are using GROUPBY properly if you are using it.

If else post your sample query, lets see to optimise!!!

[Clever_Anjos]

I my humble opinion they´re are too big.

We have a 'golden rule' here that no qvd can be more than 100 Mb.

Is there any field that you can use to split your files? (Maybe a month)