topic Re: Delete Files from s3 having Number in the FileName in Talend Studio

Delete Files from s3 having Number in the FileName

abhi90 — Thu, 01 Nov 2018 15:52:44 GMT

Hi All,

Hope everyone having good Time in Talend

I have a requirement where I have to read from files of s3. Now the Files are coming like in this name

1.1_FileName.csv

2.2_FileName.csv

This _FileName is being the constant everyday. But the Number coming in start of the FileName. in the ts3List I gave s3Path/FileName.even s3Path/_FileName.But still not iterating.

@nthampi, @rhall, @TRF, @fdenis, @vapukov, @manodwhb

Re: Delete Files from s3 having Number in the FileName

TRF — Thu, 01 Nov 2018 16:32:47 GMT

I'm afraid you have to get all the existing entries, then filter the result with something like a tFilterRow or tMap component

Re: Delete Files from s3 having Number in the FileName

abhi90 — Fri, 02 Nov 2018 10:43:00 GMT

Hi @TRF,

Can You please elaborate how to achieve this?

Hi @nthampi Can you please help on this

Re: Delete Files from s3 having Number in the FileName

Anonymous — Fri, 02 Nov 2018 11:21:02 GMT

@abhi90 - I have created a similar file iteration processing job in another post. In that job, I have not used S3, but the underlying concept remains same.

https://community.talend.com/t5/Design-and-Development/Get-two-latest-files-from-ftp-directory/m-p/139990#M86554

Could you please go through the job and try to create a similar job flow? If you are stuck somewhere, please share the job flow details and component screenshots so taht our Talend community members can go through them and share their thoughts.

Warm Regards,

Nikhil Thampi