https://community.qlik.com/t5/Talend-Studio/Parquet-performance-optimization/m-p/2264163#M44095 <P>HI All,</P> <P>&nbsp;</P> <P>We have use case where we want to convert 17TB of data(csv files) into parquet. we are using EMR spark cluster for conversion. we have designed Big data job with tFileOutputParquet component to create the file. currently our job is taking long time to convert the files. did anyone achieved parquet conversion with alternate approach and optimized design? kindly share some inputs if known.</P> <P>&nbsp;</P> <P>Thanks.</P> Sat, 16 Nov 2024 07:14:47 GMT ankushd 2024-11-16T07:14:47Z https://community.qlik.com/t5/Talend-Studio/Parquet-performance-optimization/m-p/2264163#M44095 <P>HI All,</P> <P>&nbsp;</P> <P>We have use case where we want to convert 17TB of data(csv files) into parquet. we are using EMR spark cluster for conversion. we have designed Big data job with tFileOutputParquet component to create the file. currently our job is taking long time to convert the files. did anyone achieved parquet conversion with alternate approach and optimized design? kindly share some inputs if known.</P> <P>&nbsp;</P> <P>Thanks.</P> Sat, 16 Nov 2024 07:14:47 GMT https://community.qlik.com/t5/Talend-Studio/Parquet-performance-optimization/m-p/2264163#M44095 ankushd 2024-11-16T07:14:47Z