Loading data

[parvez933]

Hi All,

I have a table with 1.6M + records and keep on adding daily basis on time stamp, for which I am trying to create a QVD from QVD Generator.

But the QVD Gen is taking more than 2 hours to run and create the QVD.

Moreover, I want only the records which have the latest time stamp.

Example:

Table of 1.6M

ID, Name, Time_Stamp

.

.

.

.

1, ABC, 6/6/2020

for today only the latest records ie 1, ABC should be picked

and for tomorrow the 1, ABC will be old record and which should be discarded and based on timestamp the latest record should be included.

I request your help.

Regards,

M. Parvez

[Saravanan_Desingh · Accepted solution]

May be this will help to keep only the last record.

tab1:
Load ID, Name, Time_Stamp
Resident..;

Right Join(tab1)
Load ID, Name, Max(Time_Stamp) As Time_Stamp
Resident tab1
Group By ID, Name;

[Brett_Bleess]

Would recommend reviewing the following links too:

https://help.qlik.com/en-US/qlikview/April2020/Subsystems/Client/Content/QV_QlikView/QVD_Incremental...

https://community.qlik.com/t5/Qlik-Design-Blog/Overview-of-Qlik-Incremental-Loading/ba-p/1466780

Regards,
Brett