Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
adolitos
Contributor
Contributor
‎2019-12-19 03:12 PM

Talend Big Data Batch - Reading from S3

Guys, I've started my tests with Talend Big Data.

Now, specifically, I'm trying to read S3 csv file to a dataframe... I Want to try to merge this data with an existent parquet file on S3.

 

0683p000009M8Oh.png

0683p000009M8Or.png

0683p000009M8DG.png

The talend is returning the following error:

0683p000009M8P1.png

 

I saw once some article or person saying that on Talend Big Data is necessary download the file from S3 to HDFS firstly and after with the file inside hdfs is possible then use a Big Data Batch job to process the data. Is it correct? Would be possible do the way I'm trying or Should I try the second approach.

 

I found really difficult to find answers to this through the internet...

 

Thanks,

 

André Santos

Labels (4)
Labels
181 Views
0 Likes
0 Replies