Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Issue of Incremental Load (Where not exist)

Hi,

My source data from one particular view gives exactly identical rows for key column (Say order id)

When I read it into QV, though it is not displaying multiple rows, I do see correct value if I apply aggregate function on numeric column (eg. Qty)

Also it loads all rows into QVD.

My problem occurs while doing incremental load. Due to data nature, I can’t use date filter and load only new set to QVD. I must use Where not exist (order id) to handle incremental load (Combine current data + (QVD data – Current data) and load back into QVD).

When I do that it reads only one row from QVD and eventually I lose those ‘duplicate’ rows from qvd.

One solution could be applying Aggr while reading data from source. But seems user wants to see ‘n’ number of rows as in source.

Do we have any work around?

Thanks

Boopathi

2 Replies
Jason_Michaelides
Partner - Master II
Partner - Master II

Try adding another field to your load:

RowNo() as QV_RowID

See if that helps.

Jason

magavi_framsteg
Partner - Creator III
Partner - Creator III

Hi mpboopathi.

I usually do like this:

- Load directly from datasource

- Concatenate where not exists orderid from QVD

- Store new QVD

Hope this helps, this solution works.

It loads the recent version of order rows directly from the data source and then concatenates orderid rows that don't exist from the QVD, then stores the new QVD.

Kind regards

Magnus Åvitsland

BI Consultant

Framsteg Business Intelligence Corp.