Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Issue of Incremental Load (Where not exist)

Hi,

My source data from one particular view gives exactly identical rows for key column (Say order id)

When I read it into QV, though it is not displaying multiple rows, I do see correct value if I apply aggregate function on numeric column (eg. Qty)

Also it loads all rows into QVD.

My problem occurs while doing incremental load. Due to data nature, I can’t use date filter and load only new set to QVD. I must use Where not exist (order id) to handle incremental load (Combine current data + (QVD data – Current data) and load back into QVD).

When I do that it reads only one row from QVD and eventually I lose those ‘duplicate’ rows from qvd.

One solution could be applying Aggr while reading data from source. But seems user wants to see ‘n’ number of rows as in source.

Do we have any work around?

Thanks

Boopathi

2 Replies
Jason_Michaelides
Luminary Alumni
Luminary Alumni

Try adding another field to your load:

RowNo() as QV_RowID

See if that helps.

Jason

magavi_framsteg
Partner - Creator III
Partner - Creator III

Hi mpboopathi.

I usually do like this:

- Load directly from datasource

- Concatenate where not exists orderid from QVD

- Store new QVD

Hope this helps, this solution works.

It loads the recent version of order rows directly from the data source and then concatenates orderid rows that don't exist from the QVD, then stores the new QVD.

Kind regards

Magnus Åvitsland

BI Consultant

Framsteg Business Intelligence Corp.