Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik GA: Multivariate Time Series in Qlik Predict: Get Details
cancel
Showing results for 
Search instead for 
Did you mean: 
PhilHibbs
Creator II
Creator II

Copying large files on S3

We are still using Talend 6.3 and the tS3Copy component fails when copying a file that is greater than 5GB.

 

The documentation says that 6.4 supports the "Part size (Mb)" advanced setting, but can anyone confirm that this is correct and not a documentation error? I have an open question ticket with Talend support about this, but hopefully I can get a real-world answer here from someone who is doing large file copies in either Talend 6.4 or 6.5..

Labels (3)
1 Solution

Accepted Solutions
PhilHibbs
Creator II
Creator II
Author

We don't have the 6.4 or 6.5 installer, I'm sure I could get it from Talend if I asked nicely.

 

However, I have resolved the issue by installing 7.2.1, creating a lookalike job, and copypasting the Java code directly into a tJava component in 6.3. Worked first time!

 

We will be migrating to 7.2.1 in the not too distant future anyway, so at that point we will drop in a working tS3Copy component in place of the tJava.

View solution in original post

3 Replies
Anonymous
Not applicable

Why don't you install v6.4 and test this feature? This parameter takes effect only when you copy an Amazon S3 object that is larger than 5 GB through multiple parts, I have never tried it yet, it makes sense if you can test this feature in your real scenario.

PhilHibbs
Creator II
Creator II
Author

We don't have the 6.4 or 6.5 installer, I'm sure I could get it from Talend if I asked nicely.

 

However, I have resolved the issue by installing 7.2.1, creating a lookalike job, and copypasting the Java code directly into a tJava component in 6.3. Worked first time!

 

We will be migrating to 7.2.1 in the not too distant future anyway, so at that point we will drop in a working tS3Copy component in place of the tJava.

Anonymous
Not applicable

Great, glad to see you have resolved it. 0683p000009MA9p.png