Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
hello,,
I'm new to qlik and I heard that we can use the QVD file to load large data to qlik...
that make me wonder.. is it really??
loading 6 Million records directly on qlik take me almost 30 min...
but from qvd, wow it take only 1 second to load it..
but the problem that loading data from source to qvd file takes also 30 min...
so both methods are the same...
can anyone explain to me what is the benefit of using (full cycle [read and write to qvd]) over (direct load) to qlik
ami missing something...?
Hi,
It is recommended to use QVD for loading the data.
There are many advantages.
1. As you know, its faster
2. You can do incremental load.
3. You can use single QVD in multiple applications and make development faster.
and so on.
about the first point ,,,
"its faster"
how time much it takes to load 40M records "TO" QVD file??? all of type number!
If the qvd's are loaded within the optimized mode which means that there is no further processing required on the data, something like:
load * from QVD.qvd (qvd);
it depends nearly complete on the performance from your used storage/network because the data within the qvd are so organized like they are used within the RAM - so it's just a transfer (the very small overhead of the xml-part of the qvd could be neglected).
- Marcus
Hello Radissoufan,
In addition to what has already been said, it depends on what your use case is.
If you are reloading the same data from source , whilst developing then having an optimised QVD load is superfast in comparison to you sitting there for 30 mins waiting for the source data to load.
If I do the load scheduled to run overnight then I can set up a QVD generator to generate my data from the source once all updates have been completed and then produce the QVD for my app to use when I start work, instead of waiting 30 mins.
Hope that helps.
Chris
Just dropping the official Help link for QVD files as well for you to review, as that may prove useful too.
https://help.qlik.com/en-US/qlikview/April2019/Subsystems/Client/Content/QV_QlikView/QVD_files.htm
If you have the information you needed, please close out the thread by either using the Accept as Solution button on one of the existing posts, or multiple posts if more than one helped, and/or you could write up a final post yourself and once posted, use the button on it to mark it summarizing things.
If you have further questions, please provide an update.
Regards,
Brett