Automate the load of incremental .csv files (append only)
I'm looking for advice on the best way to handle this scenario.
Basically each day I will receive a file containing updates with the same name "StatusUpdate.csv". The objective is to append (no update or delete required) and build up history of StatusUpdates daily in the dashboard. The text file contains a datestamp which I have artificially created at source and the volume of records is approx 5,000 which will be consistent going forward.
How do I best handle this as the file will overwrite the previous each time?
Example below. Source data doesn't hold status changes over time but I want to builf up the status history per Reg