topic Re: tS3Put- Your proposed upload exceeds the maximum allowed size in Talend Studio

tS3Put- Your proposed upload exceeds the maximum allowed size

AkshataIDX — Wed, 05 Nov 2025 04:49:05 GMT

Hi All,

In the latest Talend R2025-10 patch, the AWS SDK was upgraded to version 2.x. After this update, the tS3Put component no longer supports uploading files larger than 5 GB in a single upload. Previously (in R2025-01), the same job worked fine, but now it fails with an error — “Your proposed upload exceeds the maximum allowed size.”
I’ve tried multiple approaches, including multipart configuration, CLI upload, and SDK cleanup, but the issue still persists within Talend.

Note- It should run in both AWS and studio.

Thank you,
Akshata.

Re: tS3Put- Your proposed upload exceeds the maximum allowed size

Shicong_Hong — Thu, 06 Nov 2025 00:13:35 GMT

@AkshataIDX It seems it's Amazon S3 API limitation:

Upload an object in a single operation by using the AWS SDKs, REST API, or AWS CLI – With a single PUT operation, you can upload a single object up to 5 GB in size.

For more details, please read in Uploading objects | docs.aws.amazon.com

Can you please double check if it works with Talend Studio R2025-01 when uploading the same file? I will confirm with the R&D team if tS3Put use a different API in these two versions.

Regards

Shicong

Re: tS3Put- Your proposed upload exceeds the maximum allowed size

AkshataIDX — Thu, 06 Nov 2025 03:29:49 GMT

@Shicong_Hong

Thanks for your response. Yes, we’ve verified that the same job deployed using Talend 7.3 runs successfully in AWS without any failure message like “Your proposed upload exceeds the maximum allowed size.”

However, after migrating the job to Talend 8 and deploying it in AWS, we are consistently encountering this maximum allowed size issue when uploading files larger than 5 GB using the tS3Put component.

Kindly confirm with the R&D team if there are any changes in the S3 upload API handling between Talend 7.3 and 8 (especially after the switch to AWS SDK v2).

Thank you
Akshata

Re: tS3Put- Your proposed upload exceeds the maximum allowed size

Shicong_Hong — Fri, 07 Nov 2025 03:11:15 GMT

Thank you for your details, I will get back to you once I have any news from R&D team.

Regards

Shicong

Re: tS3Put- Your proposed upload exceeds the maximum allowed size

Shicong_Hong — Mon, 10 Nov 2025 00:35:11 GMT

@AkshataIDX I have checked with R&D team and confirmed the issue can be reproduced, it should be considered as a bug and we will fix it. Here is a workaround, hope it is helpful.

To bypass the Transfermanager and utilize multipart-upload, which is suitable for files 5GB and above, you can read the source file as a FileStream on tJava. Subsequently, store the FileStream in a globalMap variable and retrieve it in the "File or stream" field of the tS3Put component.

Regards

Shicong

Re: tS3Put- Your proposed upload exceeds the maximum allowed size

AkshataIDX — Thu, 27 Nov 2025 05:31:03 GMT

@Shicong_Hong
Thank you for your support.
we will try this solution .

Re: tS3Put- Your proposed upload exceeds the maximum allowed size

Shicong_Hong — Tue, 02 Dec 2025 05:59:17 GMT

Yes, please try the solution and let me know if you have any issues? BTW, this issue will be fixed in Talend Studio 8.0.1-R2025-12 patch.