topic Issue of Incremental Load (Where not exist) in QlikView

Issue of Incremental Load (Where not exist)

Fri, 25 May 2012 00:34:21 GMT

Hi,

My source data from one particular view gives exactly identical rows for key column (Say order id)

When I read it into QV, though it is not displaying multiple rows, I do see correct value if I apply aggregate function on numeric column (eg. Qty)

Also it loads all rows into QVD.

My problem occurs while doing incremental load. Due to data nature, I can’t use date filter and load only new set to QVD. I must use Where not exist (order id) to handle incremental load (Combine current data + (QVD data – Current data) and load back into QVD).

When I do that it reads only one row from QVD and eventually I lose those ‘duplicate’ rows from qvd.

One solution could be applying Aggr while reading data from source. But seems user wants to see ‘n’ number of rows as in source.

Do we have any work around?

Thanks

Boopathi

Issue of Incremental Load (Where not exist)

Jason_Michaelides — Fri, 25 May 2012 07:27:48 GMT

Try adding another field to your load:

RowNo() as QV_RowID

See if that helps.

Jason

Issue of Incremental Load (Where not exist)

magavi_framsteg — Fri, 25 May 2012 08:47:31 GMT

Hi mpboopathi.

I usually do like this:

- Load directly from datasource

- Concatenate where not exists orderid from QVD

- Store new QVD

Hope this helps, this solution works.

It loads the recent version of order rows directly from the data source and then concatenates orderid rows that don't exist from the QVD, then stores the new QVD.

Kind regards

Magnus Åvitsland

BI Consultant

Framsteg Business Intelligence Corp.