Data loading, appending, data management related

[hariishr]

hi 

i am new to Qlik Sense. by using for this duration i observed that using DATA LOAD EDITOR we will create NEW SECTIONS , Enter the query to create table & load data.

if we modify few things in table query & hit the LOAD DATA button again then existing content in the table is cleared & data is reloaded (fresh) with required modification.

my question is: is there option / method where data in the QS table is not changed just new info is loaded (appending).

for example: for the previous day performance, daily at 7am i get sales data with 1 million rows. i just want to append fresh data & older data in table should be present in the QS.

if we want month end report its very time consuming to load 30 millions of data for the complete month.

[IamAlbinAntony]

For this you need to store the initial table into QVD !

You load your fresh data and concatenate with existing QVD then store it again as QVD (Overwrite).  

[hariishr]

hi 

can you please elaborate how to do it, im new to QS. can it be automated (i mean, tasks can be scheduled? so system does it as per the time based trigger).

[IamAlbinAntony · Accepted solution]

For triggering the app on a daily basis, you need to schedule the task in QMC.

and the script to insert will be,

QV_Table:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#

AND ModificationTime < #$(BeginningThisExecTime)#;

Concatenate LOAD PrimaryKey, X, Y FROM File.QVD;

STORE QV_Table INTO File.QVD;

[hariishr]

ok will try, thank you