topic Re: Reading files from S3 directly in Talend Studio

Reading files from S3 directly

RJ2 — Sat, 16 Nov 2024 00:02:24 GMT

Hi All,

I have some xml and json files in S3 and want to convert these to csv format and store it another folder in S3.

Is it possible to read s3 file contents without downloading into local?

Thanks!

Re: Reading files from S3 directly

Prakhar1 — Sat, 19 Jun 2021 05:57:00 GMT

Hello, the only way i could suggest you is to use the Athena service and read your files data using Athena and then convert it to csv and move it to bucket again.

You have to create athena table for the json or xml data either using crawler or manual query.

Re: Reading files from S3 directly

Anonymous — Mon, 21 Jun 2021 07:37:31 GMT

Hello,

So far, talend doesn't support for transferring data by air.

It means you have to get your files from one S3 server into your local disk firstly and then put them to another S3 server.

Best regards

Sabrina