topic Re: Split Huge QVD into Day wise QVD in QlikView

Split Huge QVD into Day wise QVD

viveksingh — Wed, 25 Nov 2020 16:16:04 GMT

Hi All,

I have a huge QVD which is around 20GB with 2 Years of data. I want to split the QVD into Daywise. One day date to be load into one QVD. ex:ABC_QVD_20191220, ABC_QVD_20191221, ABC_QVD_20191222.....

Using For loop, I'm able to identify the mindate and maxdate, But my for loop is not wrking.

Re: Split Huge QVD into Day wise QVD

viveksingh — Fri, 03 Jan 2020 06:48:23 GMT

any inputs on this please

Re: Split Huge QVD into Day wise QVD

Kushal_Chawda — Fri, 03 Jan 2020 10:40:13 GMT

you can do something like below

let vQVDPath ='lib://QVDPath/Qvd/'; let vStoreQVDPath ='lib://StoreQVDPath/Qvd/'; let vSartDate = floor(MakeDate(2018,1,1)); let vEndDate = floor(Today()); for i= vSartDate to vEndDate let vDate = Date($(i),'YYYYMMDD'); Data: Load * FROM [$(vQVDPath)ABC_QVD.qvd] Where Floor(YourDateFieldInQVD)=$(i); Store Data into '$(vStoreQVDPath)ABC_QVD_$(vDate).qvd'; Drop Table Data; Next let i=i+1;

Note: Change variables according to your requirements.

Re: Split Huge QVD into Day wise QVD

atoz1158 — Fri, 03 Jan 2020 10:43:57 GMT

Below is the script that we used to split a large QVD, you will of course need to adapt it to your QVD and field names, also the where clause will need changing and where you are storing the daily QVD files.

vMinDate = Floor(MakeDate(2014,11,10));

vMaxDate = Floor(MakeDate(2016,06,09));

For i = vMinDate TO vMaxDate
Let vQVDDate = Date($(i),'YYYYMMDD');
Readings:
NoConcatenate
LOAD *
FROM Meter_Readings.qvd (qvd)
WHERE Floor(ReadingDate) = $(i);
If NoOfRows('Readings') > 0 Then
STORE Readings into QVD\Meter_Readings_$(vQVDDate).qvd (qvd);
ENDIF
DROP Table Readings;
Next i

Regards

Adrian

Re: Split Huge QVD into Day wise QVD

viveksingh — Sat, 04 Jan 2020 04:01:11 GMT

Thanks for the reply. I tried the same way. but my for loop is not working. Below is the that I used.

Sales:

LOAD

* from Sales_QVD(qvd);

Let vMin_Date=Date(Min(FLoor(FilterDate)),'YYYYMMDD') ;
Let vMax_Date=Date(Max(FLoor(FilterDate)),'YYYYMMDD') ;

For i = vMin_Date to vMax_Date

data:

Load *

resident sales where date=vMin_Date;

store data into sales_$(vMin_Date).qvd(qvd);

Re: Split Huge QVD into Day wise QVD

atoz1158 — Mon, 06 Jan 2020 09:03:22 GMT

Try using the following code which you should not need to change

Sales:

LOAD

* from Sales_QVD(qvd);

Let vMin_Date=Date(Min(FLoor(FilterDate)),'YYYYMMDD') ;
Let vMax_Date=Date(Max(FLoor(FilterDate)),'YYYYMMDD') ;

For i = vMin_Date TO vMax_Date

Let vQVDDate = Date($(i),'YYYYMMDD');

data:
NoConcatenate
LOAD *
resident sales where date = $(i);

If NoOfRows('data') > 0 Then
STORE data into sales_$(vQVDDate).qvd (qvd);
ENDIF

DROP Table data;

Next i

Regrads

Adrian

Re: Split Huge QVD into Day wise QVD

Brett_Bleess — Tue, 21 Jan 2020 20:35:45 GMT

Vivek, did Atoz's latest post get you what you needed? If so, do not forget to return to your thread and use the Accept as Solution button on the post to mark that as the solution, which will give Atoz credit for the help and let other Community Members know that worked. If you need further help, leave an update post.

Regards,
Brett