topic Re: tS3List Case Sensitive in Talend Studio

tS3List Case Sensitive

Papademuchos — Sat, 16 Nov 2024 00:01:07 GMT

Hello,

I'm trying to pull files from AWS using tS3List. As long as the prefix matches the file case, it works fine. But if the case is different, it passes over it. For example:

Key prefix: in

Filename: inside.txt <match>

Filename: into.txt <match>

Filename: INandOUT.txt <no match>

Is there any way to use the tS3List so it's not case-sensitive?

Thanks for your help!

Re: tS3List Case Sensitive

gjeremy1617088143 — Wed, 23 Jun 2021 15:38:15 GMT

Hi,

Unlike standard Windows file systems, the Amazon S3 storage is case-sensitive.

so you have to use tS3List four time :

Key prefix :

In.

Send me Love and Kudos

Re: tS3List Case Sensitive

Papademuchos — Wed, 23 Jun 2021 19:12:25 GMT

Wow - no way around this huh? So if I'm expecting a file "Benefit_Plan.txt" I have to anticipate all possible ways they might name that file? Currently it's required to be lower case, but I was hoping to code around that.

Re: tS3List Case Sensitive

gjeremy1617088143 — Thu, 24 Jun 2021 06:39:40 GMT

So ,i can suggest you to list all the files with the ts3List, then you can transform the name to lower case et filter on those you want.

Re: tS3List Case Sensitive

Papademuchos — Thu, 24 Jun 2021 20:13:38 GMT

This works - thanks for the suggestion. I added a tFilterRow and filtered out the ones that I want using the Advanced option with tLowerCase() and matches().