topic Re: Reload data in QlikView

Reload data

tyagishaila — Tue, 07 Apr 2015 12:41:54 GMT

Hi All,

What is the process to reload only new sales data which is not already loaded. As I have already loaded previous data.

Data is huge so we want to put previous data as it is and add new data in it.

Thanks,

Re: Reload data

sunny_talwar — Tue, 07 Apr 2015 12:44:05 GMT

You are looking for incremental load. Search it in the community and you will find a lot of examples for incremental load.

You may find this link to be useful: http://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

HTH

Best,

Sunny

Re: Reload data

avinashelite — Tue, 07 Apr 2015 12:46:35 GMT

Hi Shaila,

If its a once time effort use the Participial load concept so that it will not load the data which is loaded earlier .

Re: Reload data

PrashantSangle — Tue, 07 Apr 2015 12:49:27 GMT

Hi,

Go for incremental Load

Regards

Re: Reload data

avinashelite — Tue, 07 Apr 2015 12:50:43 GMT

Partial Reload is used whenever you just want to add some new data without reloading all other tables.

Suppose in your Qlikview file you have 10 tables which has millions of records, if you want one new table then you need to add the script, if you give normal reload it will reload all the 10 tables and the new table. Suppose if you don't want to reload the old 10 tables and just want to add new table then Partial Reload would be helpful.

This can done by using the ADD attribute to LOAD statement.

Table1:

------

Table2:

--------

Table10:

--------

Table11:

ADD LOAD * INLINE [

Key1, Value1

A, 100

B, 200

C, 100

];

Now if you use Partial reload, it just reloads the Table11.

Re: Reload data

buzzy996 — Tue, 07 Apr 2015 12:55:13 GMT

tyr with Incremental load concept.

Re: Reload data

Tue, 07 Apr 2015 12:59:10 GMT

Hi,Shaila,

Prepare a new file with new data and use "concatenate" function to load the new data to the previous record in the script.

Priyantha.

Re: Reload data

Gabriel — Tue, 07 Apr 2015 15:45:28 GMT

Hi,

If you don't want to use incremental load logic then what you can do is to have a qvw file extract the data from database or your data source, store the data as qvd file, then in the transformation qvw file use WHERE NOT EXISTS(Unique ID field) which mean you will have all the new data and the previous loaded data together. And QVD load is fast.

Hope this help

Re: Reload data

rajkumarb — Tue, 07 Apr 2015 15:55:14 GMT

I am having the same Scenario, My Sales Data for the last Four years is very huge, Created a QVD for the last 3 years and Doing a Incremental Reload on Current year data and while reloading it automatically concatenates with the Historic QVD, ALL the fields are same So using this method and really fast

Re: Reload data

tyagishaila — Thu, 09 Apr 2015 12:19:48 GMT

Could you explain me whole process

How you do it?

Thanks Shaila

Re: Reload data

prabhas277 — Thu, 09 Apr 2015 13:13:07 GMT

If you want load new data with out reloading the all other table then go for the partial load

Partial load itself means loading a portion of script

Add Keyword is used to load a table first time.

And if table is already loaded then for loading agin that table we can use below

When executing a partial script reload, all lines are executed except for LOAD and SELECT not preceded by ADD or REPLACE.

- ADD (appends or concatenates the data from one table to another table) wont checks for duplicates, REPLACE (replaces the table or overwrite)