Qlik Community

QlikView Documents

Documents for QlikView related information.

Partial Reload Easy and Simple

techvarun
Valued Contributor II

Partial Reload Easy and Simple

Hi All,

  

                Partial Reload is used whenever you just want to add some new data without reloading all other tables.

               

              

                I am having a application with 3 CSV files with large set of Data

airports.csv (6,824,049 bytes)Large file, containing information on all airports on this site.in

airport-frequencies.csv (1,167,404 bytes)Large file, listing communication frequencies for the airports in airports.csv.

runways.csv (2,844,907 )Large file, listing runways for the airports in airports.csv.

The initial load will take around 5 seconds in my system and now I am adding the word ADD and REPLACE before airports.csv and  airport-frequencies.csv

LOAD id,

     airport_ref,

     airport_ident,

     length_ft,

     width_ft,

     surface,

     lighted,

     closed,

     le_ident,

     le_latitude_deg,

     le_longitude_deg,

     le_elevation_ft,

     le_heading_degT,

     le_displaced_threshold_ft,

     he_ident,

     he_latitude_deg,

     he_longitude_deg,

     he_elevation_ft,

     he_heading_degT,

     he_displaced_threshold_ft

FROM

C:\Users\varun.prakash\Desktop\runways.csv

(txt, codepage is 1252, embedded labels, delimiter is ',', msq);

ADD LOAD id,

     ident,

     type,

     name,

     latitude_deg,

     longitude_deg,

     elevation_ft,

     continent,

     iso_country,

     iso_region,

     municipality,

     scheduled_service,

     gps_code,

     iata_code,

     local_code,

     home_link,

     wikipedia_link,

     keywords

FROM

C:\Users\varun.prakash\Desktop\airports.csv

(txt, codepage is 1252, embedded labels, delimiter is ',', msq);

REPLACE LOAD id,

     airport_ref,

     airport_ident,

     type,

     description,

     frequency_mhz

FROM

(txt, utf8, embedded labels, delimiter is ',', msq);

while doing partial reload from file menu,

When executing a partial script reload, all lines are executed except for LOAD and SELECT not preceded by ADD o REPLACE.

Partial-Reloads.jpg

it will load only the  airports.csv and airport-frequencies.csv   (Based on the ADD and REPLACE) and the reload time is less than 2 seconds.



Comments
dfoster9
Valued Contributor

Thanks for posting this.

I am curious but wouldn't your ADD load cause duplication in the Airports load?

Not applicable

i had loaded above data(csv), but it creates synthetic keys,

should i first remove syn key and then use partial load.

sudeepkm
Valued Contributor III

Can you pls advice me a solution for the given below scenario.

I've bunch of xls files as data source and loading data from it and using a QVD gen I'm creating a QVD out of it.

There is a task created in QMC for this QVDGen qvw file.

I've my main UI QVW that loads data from this QVD.

There is a task created in QMC for this UI QVW file.

Is it possible that I run the UI QVW task whenever the QVD has new data. Can Partial Reload help in this case?

I'm also posting a question on this scenario.

Version history
Revision #:
1 of 1
Last update:
‎12-03-2013 06:48 AM
Updated by: