topic Re: cAWSS3 in route job in Talend Studio

cAWSS3 in route job

Anonymous — Sat, 16 Nov 2024 07:18:49 GMT

S3 buckets having different folder structure. In the leaf folder I have to upload the file.

I am reading from rabbitmq and try uploading file to S3 in route job.when configuring the cAWSS3 component, I am giving bucket Name parameter as "parent folder/child_folder/child_folder/leaf_folder". I set the S3Key parameter, but when running the job it is giving an error as follows, anyone configured this component?

Caused by: java.lang.IllegalArgumentException: Bucket name must not be formatted as an IP Address.

Re: cAWSS3 in route job

Anonymous — Fri, 16 Nov 2018 09:40:23 GMT

Hello,

The error "Bucket name must not be formatted as an IP Address" is an AWS error.

Are you passing an IP address? Have you tried to contact AWS for support on this?

Best regards

Sabrina

Re: cAWSS3 in route job

Anonymous — Wed, 31 Jul 2019 15:57:58 GMT

Hope all is well!

I am using Talend Real time Bigdata platform. Where I can get this cAWSS3 component?

Re: cAWSS3 in route job

Anonymous — Thu, 01 Aug 2019 03:54:42 GMT

Hello @rchinta

Talend Real time Bigdata platform includes DI + DQ + ESB + TDM + BigData Batch + Big Data Streaming + iPaas enabled bundles.

cAWSS3 is talend mediation component. You will get it from ESB part.

Are you able to see "Route Designs" node in the Repository tree view from your studio? If so, please create routes by dropping different mediation components(cXXX components) from the Palette onto the design workspace and then connecting these components together.

Let us know if it works for you.

Best regards

Sabrina

Re: cAWSS3 in route job

Anonymous — Thu, 01 Aug 2019 15:34:46 GMT

Thanks Sabrina!

But I can't understand the usage of this mediation components.

My requirement is to read the files from s3 and want to load in to hdfs. This I want to achieve in the standard job by using dynamic data type option.

When I searched components to read data from s3 in standard job, I saw this mediation components but not sure whether this components will support my tasks.

Thanks

Ramesh

Re: cAWSS3 in route job

Anonymous — Fri, 02 Aug 2019 05:19:29 GMT

Hello,

If you want to use S3 in standard job, please have a look at Amazon S3 components.

https://help.talend.com/reader/MEJTft6Phcbzeotwjs0Ivw/mpZ3LiDVmIW1KXU6M~N8Cg

Best regards

Sabrina