cAWSS3 in route job

[Anonymous]

Hi 

S3 buckets having different folder structure. In the leaf folder I have to upload the file.

I am reading from rabbitmq and try uploading file to S3 in route job.when configuring the cAWSS3 component, I am giving bucket Name parameter as "parent folder/child_folder/child_folder/leaf_folder". I set the S3Key parameter, but when running the job it is giving an error as follows, anyone configured this component?

Caused by: java.lang.IllegalArgumentException: Bucket name must not be formatted as an IP Address.

[Anonymous]

Hello,

The error "Bucket name must not be formatted as an IP Address" is an AWS error.

Are you passing an IP address? Have you tried to contact AWS for support on this?

Best regards

Sabrina

[Anonymous]

Hi

Hope all is well!

I am using Talend Real time Bigdata platform. Where I can get this cAWSS3 component?

[Anonymous]

Hello @rchinta 

Talend Real time Bigdata platform includes DI + DQ + ESB + TDM + BigData Batch + Big Data Streaming + iPaas enabled bundles.

cAWSS3 is talend mediation component. You will get it from ESB part.

Are you able to see "Route Designs" node in the Repository tree view from your studio? If so, please create routes by dropping different mediation components(cXXX components) from the Palette onto the design workspace and then connecting these components together. 

Let us know if it works for you.

Best regards

Sabrina

[Anonymous]

Thanks Sabrina!

But I can't understand the usage of this mediation components.

My requirement is to read the files from s3 and want to load in to hdfs. This I want to achieve in the standard job by using dynamic data type option.

When I searched components to read data from s3 in standard job, I saw this mediation components but not sure whether this components will support my tasks.

Thanks

Ramesh

[Anonymous]

Hello,

If you want to use S3 in standard job, please have a look at Amazon S3 components.

https://help.talend.com/reader/MEJTft6Phcbzeotwjs0Ivw/mpZ3LiDVmIW1KXU6M~N8Cg

Best regards

Sabrina