topic Re: Get incremental/Update data in QlikView

Get incremental/Update data

katetsan — Wed, 25 Nov 2020 16:16:04 GMT

Hi Communities,

I'm trying to find the scripts of incremental or updated data only, but the script I found is concatenating all data into one table.

(https://help.qlik.com/en-US/sense/November2017/Subsystems/Hub/Content/LoadData/use-QVD-files-incremental-load.htm)

I'm wondering if there's any way to get the inserted/updated data only without concatenate.

Thanks in advanced.

Kate

Re: Get incremental/Update data

prma7799 — Mon, 04 Dec 2017 03:05:36 GMT

Please check this

https://www.resultdata.com/three-types-of-qlikview-incremental-loads/

Where Not Exists() in Incremental load for Insert and Update case

https://community.qlikview.com/thread/2668

Re: Get incremental/Update data

katetsan — Mon, 04 Dec 2017 03:12:11 GMT

Hi PM,

According to the link you proved, the concept is comparing with two data source and "Concatenate" into one table. I'm looking for the way to export the incremental/updated data only.

Thanks.

Re: Get incremental/Update data

Anil_Babu_Samineni — Mon, 04 Dec 2017 05:17:39 GMT

this is the case, Why not with direct SQL operations here instead increment load?

Re: Get incremental/Update data

katetsan — Mon, 04 Dec 2017 05:34:52 GMT

Hi Anil,

I'm using SAP connector to extract data. Could you please provide more information about SQL operations?

Re: Get incremental/Update data

Anil_Babu_Samineni — Mon, 04 Dec 2017 05:41:04 GMT

Insert - It helps for adding and/or inserting the rows into Qlikview

SQL SELECT INSERT INTO TableName ...;

The same UPDATE command uses works as Request <- and Response -> to users without any hanging helping 3rd part software. But, where you talk about SAP data we are loading that means SAP needs to deal with QVD for a instance. Are you? If so, After that what you mean by insert / update in your manner?

Re: Get incremental/Update data

katetsan — Mon, 04 Dec 2017 06:00:07 GMT

Hi Anil,

We're planning to extract data from SAP database regularly via connector, so it's kinda different from inserting data via qlik.

Concern on the efficiency, we have to compare the data set retrieved by this time and last time, and recognize which record is new inserted or updated and store the inserted/updated data into qvd.

Instead of concatenating the old data set and the new (inserted/updated) data.

Re: Get incremental/Update data

Anil_Babu_Samineni — Mon, 04 Dec 2017 06:10:44 GMT

that means, You are needed Simply this perhaps?

Table:

Load Date from Table;

Store Final into Path.Qvd (qvd);

Drop Table Table;

Final:

NoConcatenate

Load Date from Table;

Increment:

Load Max(Date) as Max_Date Resident Final;

LET Variable = Peek('Max_Date',0,'Increment');

Drop Table Increment;

Final_Incr:

Load Date From QVD Where Date >= '$(Variable)';