topic How to load files recursively from s3 into redshift in Talend Studio

How to load files recursively from s3 into redshift

Anonymous — Mon, 23 Jan 2017 23:42:25 GMT

I have different sub-folders in s3 bucket. How to pass filenames from tS3List to tS3Get then load to redshift? what to use as key?
bucket structure is like:
bucket/text/filename-001
bucket/text/filename-002
bucket/text/filename-003
bucket/images/filename-001-images
bucket/images/filename-002-images

Re: How to load files recursively from s3 into redshift

Anonymous — Mon, 13 Feb 2017 08:09:55 GMT

Hi,
For key prefix, you can enter the prefix of files to be listed. This way, only files with that prefix will be listed.
Here is the component reference:TalendHelpCenter:tS3List with a related scenario.
Best regards
Sabrina