Connect to S3 Minio buckets (S3 buckets not hosted in AWS)

[ojc]

Hello,

I have tried to use the Amazon S3 connector to connect to S3 compliant buckets hosted in another infrastructure than AWS using Minio (https://min.io) but I can't manage get/put any files. There seems to be some issue with the way the connection is done.

Has anyone managed to do a similar setup? Does Talend support S3 buckets not hosted in AWS?

Thanks!

[AAzulay1683114613]

Hi Nobody can help this kind of problem ? Is pseudo S3 supported on Talend component ?

[Alicehatley]

Yes, it is possible to connect to S3-compliant buckets hosted on infrastructure other than AWS using Talend and Minio. However, there may be some configuration differences that need to be taken into account.

To connect to a Minio S3 bucket using Talend, you can Wyndham Rewards Visa use the tS3Connection component in Talend Studio. When configuring the component, you will need to specify the endpoint URL for your Minio instance and provide the appropriate access and secret keys.

Additionally, you may need to adjust some settings related to SSL/TLS verification or specify the correct region and endpoint for your Minio instance.

It's also worth noting that some features of the Amazon S3 connector may not be available when connecting to a non-AWS S3-compliant bucket, so you may need to adjust your job design accordingly.

Overall, while it may require some additional configuration, connecting to S3-compliant buckets hosted on infrastructure other than AWS using Talend and Minio is definitely possible.

[AAzulay1683114613]

Do you have documentation about how to do ?