Get incremental/Update data

[katetsan]

Hi Communities,

I'm trying to find the scripts of incremental or updated data only, but the script I found is concatenating all data into one table.

(https://help.qlik.com/en-US/sense/November2017/Subsystems/Hub/Content/LoadData/use-QVD-files-increme...)

I'm wondering if there's any way to get the inserted/updated data only without concatenate.

Thanks in advanced.

Kate

[prma7799]

Please check this

https://www.resultdata.com/three-types-of-qlikview-incremental-loads/

Where Not Exists() in Incremental load for Insert and Update case

https://community.qlikview.com/thread/2668

[katetsan]

Hi PM,

According to the link you proved, the concept is comparing with two data source and "Concatenate" into one table. I'm looking for the way to export the incremental/updated data only.

Thanks.

[Anil_Babu_Samineni]

this is the case, Why not with direct SQL operations here instead increment load?

[katetsan]

Hi Anil,

I'm using SAP connector to extract data. Could you please provide more information about SQL operations?

[Anil_Babu_Samineni]

Insert - It helps for adding and/or inserting the rows into Qlikview

SQL SELECT INSERT INTO TableName ...;

The same UPDATE command uses works as Request <- and Response -> to users without any hanging helping 3rd part software. But, where you talk about SAP data we are loading that means SAP needs to deal with QVD for a instance. Are you? If so, After that what you mean by insert / update in your manner?

[katetsan]

Hi Anil,

We're planning to extract data from SAP database regularly via connector, so it's kinda different from inserting data via qlik.

Concern on the efficiency, we have to compare the data set retrieved by this time and last time, and recognize which record is new inserted or updated and store the inserted/updated data into qvd.

Instead of concatenating the old data set and the new (inserted/updated) data.

[Anil_Babu_Samineni]

that means, You are needed Simply this perhaps?

Table:

Load Date from Table;

Store Final into Path.Qvd (qvd);

Drop Table Table;

Final:

NoConcatenate

Load Date from Table;

Increment:

Load Max(Date) as Max_Date Resident Final;

LET Variable = Peek('Max_Date',0,'Increment');

Drop Table Increment;

Final_Incr:

Load Date From QVD Where Date >= '$(Variable)';