How can I skip an S3 upload in error

[srea1989]

Hi folks - 

I would like to skip an s3 upload that is in error - because its failing the entire QLIK task due to going over the multipart upload limit - we'll do a full reload at a later date.

We manually removed the files here to try and get replicate task to ignore it but it still persists in trying to upload the file. 

Failed to write a file to the final destination.
source file 'D:\Attunity\data\tasks\blah\20260130-012735436.json' is missing

We cannot do a reload from target yet as the data volume is massive - we simply want to ignore this error and continue. 

We've also removed the erroneous table from the table list.

Regards

[john_wang]

Hello @srea1989 ,

The current version of Replicate does not support resumable transfers. However, you may try the following workaround to see if it meets your needs:

1. Stop the task when the error occurs.

2. In the GUI, select the table(s) you want to reload and click “Reload…” to reload only those selected tables.

   

3. Resume the task. Replicate will reload the selected tables only.

Hope this helps.

John.

[DesmondWOO]

Hi @srea1989 ,

The maximum file size supported by the Qlik Replicate S3 endpoint is 100,000,000 KB (approximately 100 GB). This is well below the Amazon S3 maximum object size limit of 48.8 TiB, so the error is not related to the overall object size.

A likely cause is that the upload is hitting the Amazon S3 limit of 10,000 parts per multipart upload. If Qlik Replicate is using a relatively small internal part size, a file close to 100 GB could exceed this part count limit. I recommend opening a support ticket with Qlik to confirm the internal part size parameter and whether it can be adjusted.

Regarding your issue, one possible workaround is to temporarily exclude the problematic table from the task so that the rest can continue. 

Regards,
Desmond

[srea1989]

okay this is the issue around the 10,000 parts - however this version QLIK replicate does not have a partsize option. I'll open a support ticket to see if we can increase that size.

[srea1989]

Having a problem trying to access your customer portal.

[DesmondWOO]

Hi @srea1989 ,

In the customer portal, you’ll see a ‘Chat Now’ option at the bottom-right corner. Could you contact our support team through that chat? 

Regards,
Desmond