https://community.qlik.com/t5/Talend-Studio/Talend-Big-Data-Batch-Reading-from-S3/m-p/2225084#M17531 <P>Guys, I've started my tests with Talend Big Data.</P> <P>Now, specifically, I'm trying to read S3 csv file to a dataframe... I Want to try to merge this data with an existent parquet file on S3.</P> <P>&nbsp;</P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="1.PNG" style="width: 666px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8Oh.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/150260i37A803B08D4B358A/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8Oh.png" alt="0683p000009M8Oh.png" /></span></SPAN></P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="2.PNG" style="width: 999px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8Or.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/147935i050E1B91EF28D141/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8Or.png" alt="0683p000009M8Or.png" /></span></SPAN></P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="3.PNG" style="width: 999px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8DG.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/148097i80F46491FE067AEF/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8DG.png" alt="0683p000009M8DG.png" /></span></SPAN></P> <P>The talend is returning the following error:</P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="4.PNG" style="width: 900px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8P1.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/143709i5DD554D9AE80A836/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8P1.png" alt="0683p000009M8P1.png" /></span></SPAN></P> <P>&nbsp;</P> <P>I saw once some article or person saying that on Talend Big Data is necessary download the file from S3 to HDFS firstly and after with the file inside hdfs is possible then use a Big Data Batch job to process the data. Is it correct? Would be possible do the way I'm trying or Should I try the second approach.</P> <P>&nbsp;</P> <P>I found really difficult to find answers to this through the internet...</P> <P>&nbsp;</P> <P>Thanks,</P> <P>&nbsp;</P> <P>André Santos</P> Sat, 16 Nov 2024 03:45:43 GMT adolitos 2024-11-16T03:45:43Z https://community.qlik.com/t5/Talend-Studio/Talend-Big-Data-Batch-Reading-from-S3/m-p/2225084#M17531 <P>Guys, I've started my tests with Talend Big Data.</P> <P>Now, specifically, I'm trying to read S3 csv file to a dataframe... I Want to try to merge this data with an existent parquet file on S3.</P> <P>&nbsp;</P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="1.PNG" style="width: 666px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8Oh.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/150260i37A803B08D4B358A/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8Oh.png" alt="0683p000009M8Oh.png" /></span></SPAN></P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="2.PNG" style="width: 999px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8Or.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/147935i050E1B91EF28D141/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8Or.png" alt="0683p000009M8Or.png" /></span></SPAN></P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="3.PNG" style="width: 999px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8DG.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/148097i80F46491FE067AEF/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8DG.png" alt="0683p000009M8DG.png" /></span></SPAN></P> <P>The talend is returning the following error:</P> <P><SPAN class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="4.PNG" style="width: 900px;"><span class="lia-inline-image-display-wrapper" image-alt="0683p000009M8P1.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/143709i5DD554D9AE80A836/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009M8P1.png" alt="0683p000009M8P1.png" /></span></SPAN></P> <P>&nbsp;</P> <P>I saw once some article or person saying that on Talend Big Data is necessary download the file from S3 to HDFS firstly and after with the file inside hdfs is possible then use a Big Data Batch job to process the data. Is it correct? Would be possible do the way I'm trying or Should I try the second approach.</P> <P>&nbsp;</P> <P>I found really difficult to find answers to this through the internet...</P> <P>&nbsp;</P> <P>Thanks,</P> <P>&nbsp;</P> <P>André Santos</P> Sat, 16 Nov 2024 03:45:43 GMT https://community.qlik.com/t5/Talend-Studio/Talend-Big-Data-Batch-Reading-from-S3/m-p/2225084#M17531 adolitos 2024-11-16T03:45:43Z