Partial Reload Easy and Simple

    Hi All,

      

     

                    Partial Reload is used whenever you just want to add some new data without reloading all other tables.

                   

                  

     

     

                    I am having a application with 3 CSV files with large set of Data

     

    airports.csv (6,824,049 bytes)Large file, containing information on all airports on this site.in

     

    airport-frequencies.csv (1,167,404 bytes)Large file, listing communication frequencies for the airports in airports.csv.

     

    runways.csv (2,844,907 )Large file, listing runways for the airports in airports.csv.

     

     

    The initial load will take around 5 seconds in my system and now I am adding the word ADD and REPLACE before airports.csv and  airport-frequencies.csv

     

    LOAD id,

         airport_ref,

         airport_ident,

         length_ft,

         width_ft,

         surface,

         lighted,

         closed,

         le_ident,

         le_latitude_deg,

         le_longitude_deg,

         le_elevation_ft,

         le_heading_degT,

         le_displaced_threshold_ft,

         he_ident,

         he_latitude_deg,

         he_longitude_deg,

         he_elevation_ft,

         he_heading_degT,

         he_displaced_threshold_ft

    FROM

    C:\Users\varun.prakash\Desktop\runways.csv

    (txt, codepage is 1252, embedded labels, delimiter is ',', msq);

     

     

    ADD LOAD id,

         ident,

         type,

         name,

         latitude_deg,

         longitude_deg,

         elevation_ft,

         continent,

         iso_country,

         iso_region,

         municipality,

         scheduled_service,

         gps_code,

         iata_code,

         local_code,

         home_link,

         wikipedia_link,

         keywords

    FROM

    C:\Users\varun.prakash\Desktop\airports.csv

    (txt, codepage is 1252, embedded labels, delimiter is ',', msq);

     

    REPLACE LOAD id,

         airport_ref,

         airport_ident,

         type,

         description,

         frequency_mhz

    FROM

    [C:\Users\varun.prakash\Desktop\airport-frequencies.csv]

    (txt, utf8, embedded labels, delimiter is ',', msq);

     

     

     

    while doing partial reload from file menu,

    When executing a partial script reload, all lines are executed except for LOAD and SELECT not preceded by ADD o REPLACE.

     

     

    Partial-Reloads.jpg

     

    it will load only the  airports.csv and airport-frequencies.csv   (Based on the ADD and REPLACE) and the reload time is less than 2 seconds.