https://community.qlik.com/t5/Talend-Studio/Hadoop-hdfs-block-size/m-p/2249951#M34326 <P><A href="https://community.qlik.com/s/profile/00539000003YkYmAAK">@badri-nair</A>&nbsp;,check below link will help you to understand.</P> <P><A href="https://www.talend.com/blog/2018/04/12/apache-spark-performance-and-tuning-blog/" target="_blank" rel="nofollow noopener noreferrer">https://www.talend.com/blog/2018/04/12/apache-spark-performance-and-tuning-blog/</A></P> Thu, 07 Feb 2019 12:53:25 GMT manodwhb 2019-02-07T12:53:25Z https://community.qlik.com/t5/Talend-Studio/Hadoop-hdfs-block-size/m-p/2249950#M34325 <P>I am unloading data from oracle database into Hadoop.</P> <P>landing the file as as HDFS file. But the unloaded file is a single file 750 MB in size.</P> <P>Can anyone please help me understand why its acting so. I would like to have each part file 128 MB in size.</P> <P>where do i have to update the settings ?</P> <P><BR />Found 2 items<BR />-rw-r--r-- 3 hdfs supergroup 0 2019-02-07 07:37 /var/lib/hadoop-hdfs/lake/itineraryitem2/_SUCCESS<BR />-rw-r--r-- 3 hdfs supergroup 730087184 2019-02-07 07:37 /var/lib/hadoop-hdfs/lake/itineraryitem2/part-00000</P> <P>&nbsp;</P> Sat, 16 Nov 2024 06:39:05 GMT https://community.qlik.com/t5/Talend-Studio/Hadoop-hdfs-block-size/m-p/2249950#M34325 badri-nair 2024-11-16T06:39:05Z https://community.qlik.com/t5/Talend-Studio/Hadoop-hdfs-block-size/m-p/2249951#M34326 <P><A href="https://community.qlik.com/s/profile/00539000003YkYmAAK">@badri-nair</A>&nbsp;,check below link will help you to understand.</P> <P><A href="https://www.talend.com/blog/2018/04/12/apache-spark-performance-and-tuning-blog/" target="_blank" rel="nofollow noopener noreferrer">https://www.talend.com/blog/2018/04/12/apache-spark-performance-and-tuning-blog/</A></P> Thu, 07 Feb 2019 12:53:25 GMT https://community.qlik.com/t5/Talend-Studio/Hadoop-hdfs-block-size/m-p/2249951#M34326 manodwhb 2019-02-07T12:53:25Z