Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
AWS Degraded - You may experience Community slowness, timeouts, or trouble accessing: LATEST HERE
cancel
Showing results for 
Search instead for 
Did you mean: 
sakshikaul
Creator II
Creator II

how to manage incremental load

Hi 

I have a scenario In which I will get full load for orders in csv format

i will also  get records (incremental records ) ie only those records which have been changed on daily basis in csv format in same folder where full load is kept. The records which I am getting as an incremental load will be created on basis of date and time.

for eg I have two files 

File Full Load  contains all the records lets say 

item  order_no   qty 

A       1112879       20 

B       1123445       5

c        2336788       9

file increment load will contain record as follows

A        11112879     4

so increment file (which is created on daily basis) will only contain one record (changed record ) not the rest records

now I want to load (full load) once and only the increment files on daily basis. so how to handle the same ?

LET vToday = date(today(), 'YYYYMMDD');

Full_Order_Data:
LOAD Plant,
OrderNo,
OrderDate,
OrderType,
DistChannel,
Division,
NCODE,
Season,
MatType,
Style,
Color,
Size,
OrderQty,
OrderValue,
ConfirmedQty,
ConfirmedValue,
MRP
FROM [D:\Qlik_OrderSheets\OrderSheets\QLIK*$(vToday)*.CSV]
(txt, codepage is 1252, embedded labels, delimiter is ',', msq);

this above statement will only execute current files but not the full load so how to handle the same ?

please help @marcus_sommer

12 Replies
ahmed_hassan
Contributor III
Contributor III

Looks perfect, I assume that [D:\Qlik_Master\Material_master\MAT_MAS_*$(vToday)*.txt] contains the current records.
sakshikaul
Creator II
Creator II
Author

yes

sakshikaul
Creator II
Creator II
Author

Hi 

I have a query if suppose on ftp the file is not created on basis of today's date then that particular file will be missed so how to handle that particular thing?