Automate the load of incremental .csv files (append only)

[#1]

I'm looking for advice on the best way to handle this scenario.

Basically each day I will receive a file containing updates with the same name "StatusUpdate.csv". The objective is to append (no update or delete required) and build up history of StatusUpdates daily in the dashboard. The text file contains a datestamp which I have artificially created at source and the volume of records is approx 5,000 which will be consistent going forward.

How do I best handle this as the file will overwrite the previous each time?

Example below. Source data doesn't hold status changes over time but I want to builf up the status history per Reg

DateStamp	Reg	Status
25/10/2013	10lm15	A
25/10/2013	11lm16	B
25/10/2013	00km45	A

[Jason_Michaelides]

I would use QlikView to load and append to a QVD file, then also run a dos command to rename the source file with the date stamp to keep a history of the csv files.

[#3]

Hi Natalie,

either you store your loaded data every day into a qvd and then the next day you concatenate .csv to .qvd in the same table

either you can use a partial load using ADD LOAD but it can be a bit touchy if you involve many tables in the script

best regards

Chris

[#4]

Thanks guys... I will try both and let you know how I go.