topic How to move files from S3 to HDFS using Talend? in Talend Studio

How to move files from S3 to HDFS using Talend?

ansudharsanan — Sat, 16 Nov 2024 09:16:51 GMT

Hi All,

In our project, we have requirement to move a csv files from S3 to HDFS using Talend. We would like to avoid moving to local and directly copy the files from Amazon S3 to EMR - Hadoop HDFS files. Please let us know if this is possible using Talend.

Thanks
Sudhar

Re: How to move files from S3 to HDFS using Talend?

Anonymous — Mon, 18 Sep 2017 06:32:40 GMT

Hello,

So far, talend don't support for transferring data by air.

You have to get your data from S3 server (tS3Get component)to local firstly and then write your data into HDFS.

Best regards

Sabrina