I need some help in trying to determine the best way to load new data. There will be an initial load of all data and then each day new files are created and dumped to an FTP server. The files contain the data from the previous day. The file naming convention is as follows:
website_history2009-10-01_200933.csv
website_history2009-10-02_200933.csv
website_history2009-10-03_200933.csv
etc.
Any suggestions on how I could load the additional data from the new files each day?