topic Re: Process files having yesterday timestamp in filename in Talend Studio

Process files having yesterday timestamp in filename

Parikhharshal — Sat, 16 Nov 2024 02:18:12 GMT

Hi there

I have a scenario like this:

From Google cloud bucket I am downloading all the files from particular bucket to local folder and get all different files like this:

I want to get activities_05272020_*.gz and books_05272020_*.gz file and process them. Like this, every day new file will be arriving and I will have to process previous day file.

What's the best way to resolve this?

Thanks

Harshal.

Re: Process files having yesterday timestamp in filename

Anonymous — Thu, 28 May 2020 07:11:47 GMT

Hi
Using a tFileList to iterate the files under the specified folder, set the filemask as:
"*_"+TalendDate.formatDate("MMddyyyy", TalendDate.addDate(TalendDate.getCurrentDate(), -1, "dd"))+"_*.gz"

Regards
Shong

Re: Process files having yesterday timestamp in filename

Parikhharshal — Thu, 28 May 2020 07:21:01 GMT

That's awesome.

I will try @shong .

How can I unzip .gz files and put it into different table eg in this case one file goes into activity and another one goes into book table?