Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Join us at Qlik Connect for 3 magical days of learning, networking,and inspiration! REGISTER TODAY and save!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
vvazza10
Contributor III
Contributor III
‎2020-02-17 04:59 PM

Loading 100GB file from local to S3

Hi ! I have a use case where-in the talend job should load 100 GB pipe delimited file residing on-premises to Amazon S3. The EC2 in which the remote engine has been installed can hold only 30 GB of data. Could you please advise how 100 GB file can be transferred to S3 from local?

76 Views
0 Likes
1 Reply
manodwhb
Champion II
Champion II
‎2020-02-18 12:12 AM

@vvazza10 , I will suggest you to create a Talend sprak batch job and execute on EMR,which will process faster to do this.

 

76 Views
0 Likes