topic Re: Reload New Data Only in QlikView

Reload New Data Only

priyarane — Wed, 25 Nov 2020 16:16:04 GMT

Hi Community,

Can some one suggest is there any way to load only current month data only with old data.

For Ex:

I have 2 months of data

1. Dec

2. Nov

For total month Dec will update and Nov never update again. But when we go for refresh Dashboards are required to reload both.

So Here I am looking like Dashboard has to refresh but pick only Dec and not for Nov but Nov data should be available.

Is there any way we can do. Pls suggest.

- Priya

Re: Reload New Data Only

giakoum — Mon, 05 Dec 2016 12:35:32 GMT

it is called incremental load. You save now in a qvd and only load dec based on some unique key or last_updated date usually using the exists function. Lots of posts in the forum. Try searching for incremental load.

Re: Reload New Data Only

giakoum — Mon, 05 Dec 2016 12:36:48 GMT

Incremental load for beginner with example

Re: Reload New Data Only

vikasmahajan — Mon, 05 Dec 2016 12:37:01 GMT

Addition : Please refer this link to implement a incremental load

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

Vikas

Re: Reload New Data Only

priyarane — Mon, 05 Dec 2016 12:43:32 GMT

I am not looking for extract the data, I am looking for Dashboard.

Re: Reload New Data Only

priyarane — Mon, 05 Dec 2016 12:43:40 GMT

I am not looking for extract the data, I am looking for Dashboard.

Re: Reload New Data Only

giakoum — Mon, 05 Dec 2016 12:46:41 GMT

You need to elaborate a little, I don't understand what you need.

Re: Reload New Data Only

priyarane — Mon, 05 Dec 2016 13:11:52 GMT

For extracting data from Database/ Source we can use Incremental load but incase of Dashboard we have to load full data. but my case there are 2 months and only one month will be update always in that case load one month(for ex: dec only not for nov), but dashboard should show nov also.

Re: Reload New Data Only

jonathandienst — Mon, 05 Dec 2016 13:33:28 GMT

If the extract is well structured for your requirements, then you can load millions of rows in only a few seconds using optimised loads from qvd files. The immutable history for November should be in stored in a different QVD to December, and as November should require no calculations, you can load November very quickly - why is that a problem?

You can use partial loads, but IMHO that is a poor solution for your problem.

Re: Reload New Data Only

priyarane — Mon, 05 Dec 2016 15:23:37 GMT

In real, we have 13 months of data, but only current month only have updated data so we wanted to avoid 12 months of data to be load every time.

Re: Reload New Data Only

muthukumar77 — Mon, 05 Dec 2016 17:05:17 GMT

Hi,

1. Save you Nov and Dec month data as QVD format.

2. Load QVD file only Dec month data. I mean put where condition " Month = 'Dec' "

Re: Reload New Data Only

everest226 — Tue, 06 Dec 2016 00:36:23 GMT

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/