topic Re: AWS S3 Job in Talend Studio

AWS S3 Job

EmmanuelTrejo — Fri, 15 Nov 2024 23:06:19 GMT

Hi everyone,

I found how to work with files from AWS S3 without download those files and run other job. As you can see don't send the files to my PC but don't where the files are!! Finally I want to know how I can replace tFileList component for the AWS S3 component.

I hope any one can help me to fixed this trouble, I appreciate.

Regards.

Re: AWS S3 Job

Anonymous — Fri, 18 Mar 2022 01:58:45 GMT

I'm sorry, it is not very clear what you are trying to do. Can you try explaining in a different way?

Re: AWS S3 Job

Anonymous — Fri, 18 Mar 2022 05:42:40 GMT

If i understand your question well, you want to read the files directly from S3, unfortunately, there is no S3 API for this.

Regards

Shong

Re: AWS S3 Job

EmmanuelTrejo — Fri, 25 Mar 2022 15:43:31 GMT

Hi shong,

That's exatly I want to do, If I understand that is not possible yet?

Any other solution to do that?

Regards.

Re: AWS S3 Job

Anonymous — Fri, 25 Mar 2022 16:07:37 GMT

Download them, read them and delete them. Alternatively, you may be able to find some Java online to stream the data. But from what I have seen, this can be prone to issues if the the stream closes.

Re: AWS S3 Job

EmmanuelTrejo — Mon, 28 Mar 2022 19:52:49 GMT

If I want to use get tigger "run if", how do I configure it the job is not executed until the S3 connection finishes executing

Regards

Re: AWS S3 Job

Anonymous — Mon, 28 Mar 2022 23:38:40 GMT

The S3 Connection should be created and run in a previous subjob.