topic Re: Incremental load without incremental identification column in QlikView

Incremental load without incremental identification column

Anonymous — Wed, 25 Nov 2020 16:16:04 GMT

I am new in Qlikview, i have a case where columns named as Id(Char type and Unique), F_name, L_name, Date_of_Birth. New rows get inserted having random id

What could be filtration criteria for incremental load or column with incremental identification is necessary in source of data

Re: Incremental load without incremental identification column

felipedl — Mon, 25 Jun 2018 15:56:53 GMT

Hi Santhosh,

Do you have the entry added date?

You could make your incremental load based on ReloadTime() function, getting only the records that have dates greater then the ReloadTime() date.

Felipe.

Re: Incremental load without incremental identification column

Anonymous — Tue, 26 Jun 2018 03:53:36 GMT

Thanks Felipe

Re: Incremental load without incremental identification column

jonathandienst — Tue, 26 Jun 2018 06:08:04 GMT

Does the Id field increase for each load? You could use the maximum loaded Id field to filter the incremental load.

LOAD Max(Id) as MaxID FROM Incremental.qvd (qvd);

Let vMaxID = Peek('MaxID');

Data:

SQL

Select Id, .....

Where Id > '$(vMaxID)';

Concatenate (Data)

LOAD * ROM Incremental.qvd (qvd);

If the Id field can't be used like that and there is no updated or created date field, then you will not be able to load this data incrementally.