topic How to get the latest file from a directory? in Talend Studio

How to get the latest file from a directory?

rp2018 — Fri, 15 Nov 2024 22:08:48 GMT

I have following 4 files as an example in c:\temp directory and would like to get the latest file to load to the sql server database.

How to design a job to get the latest file?

File format: filename_yyyyMMdd_HHmmss.csv

Test_20230201_092511.csv

Test_20230201_093025.csv

Test_20230201_095010.csv

Test_20230201_095515.csv

Anonymous — Thu, 02 Feb 2023 02:57:56 GMT

Hello @Ranjan Patel ,

Maybe you can design the job like :

use tFileList to list all the csv files in the folder and sort by filename 'DESC' as the below

2 add the tJava to get the top 1 file path and setup context variable "latest_file_path" to save it as the below

3 add tFileInputDelimited to read the file path context.latest_file_path and send the content to sqlserver db by tDBOutput as the below