How to Iterate all folders in s3 list component

Vijay_K_N — Fri, 15 Nov 2024 21:55:26 GMT

I have the necessary items(test_20230404.csv) in each subfolder. how to iterate through all subfolders in the S3 list component and extract the necessary items from them

Example: s3://devbucket/data/travel/

in above path we have multiple sub folders

s3://devbucket/data/travel/processed

s3://devbucket/data/travel/archive

s3://devbucket/data/travel/oldfiles

on s3 list component I mentioned bucket name "

devbucket"

and key place "

data/travel/test_"

but I want to iterate through every subfolder in the travel folder.

Re: How to Iterate all folders in s3 list component

Anonymous — Thu, 06 Apr 2023 07:52:15 GMT

Hello @Vijay Kumar N ,

To achieve your goal, in tS3List component, please setup bucket name to "devbucket", and Key prefix to "data/travel" as the below, in tJava component, output the key name by

System.out.println(globalMap.get("tS3List_1_CURRENT_KEY"));

Thanks

Aiming

topic How to Iterate all folders in s3 list component in Talend Studio

How to Iterate all folders in s3 list component

Re: How to Iterate all folders in s3 list component