Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
vvazza10
Contributor III
Contributor III
‎2020-02-17 04:59 PM

Loading 100GB file from local to S3

Hi ! I have a use case where-in the talend job should load 100 GB pipe delimited file residing on-premises to Amazon S3. The EC2 in which the remote engine has been installed can hold only 30 GB of data. Could you please advise how 100 GB file can be transferred to S3 from local?

56 Views
0 Likes
1 Reply
manodwhb
Champion II
Champion II
‎2020-02-18 12:12 AM

@vvazza10 , I will suggest you to create a Talend sprak batch job and execute on EMR,which will process faster to do this.

 

56 Views
0 Likes