https://community.qlik.com/t5/Qlik-Replicate/Using-Parquet-format-in-HDFS-as-the-target/m-p/2425641#M9909 <P>Hello community,</P> <P>How can we do&nbsp;partitioning on target table in Qlik Replicate when file format of HDFS is set to&nbsp;Parquet format?&nbsp;</P> <P>&nbsp;</P> <P>&nbsp;</P> <P><SPAN>Thanks Regards,</SPAN></P> <P><SPAN>Pranita</SPAN></P> Fri, 01 Mar 2024 05:38:23 GMT Pranita123 2024-03-01T05:38:23Z https://community.qlik.com/t5/Qlik-Replicate/Using-Parquet-format-in-HDFS-as-the-target/m-p/2425641#M9909 <P>Hello community,</P> <P>How can we do&nbsp;partitioning on target table in Qlik Replicate when file format of HDFS is set to&nbsp;Parquet format?&nbsp;</P> <P>&nbsp;</P> <P>&nbsp;</P> <P><SPAN>Thanks Regards,</SPAN></P> <P><SPAN>Pranita</SPAN></P> Fri, 01 Mar 2024 05:38:23 GMT https://community.qlik.com/t5/Qlik-Replicate/Using-Parquet-format-in-HDFS-as-the-target/m-p/2425641#M9909 Pranita123 2024-03-01T05:38:23Z https://community.qlik.com/t5/Qlik-Replicate/Using-Parquet-format-in-HDFS-as-the-target/m-p/2426245#M9954 <P>Hello&nbsp;<a href="https://community.qlik.com/t5/user/viewprofilepage/user-id/219875">@Pranita123</a>&nbsp;,</P> <P>Thanks for reaching out to Qlik Community!</P> <P><A title="Change Data Partitioning" href="https://help.qlik.com/en-US/replicate/November2023/Content/Global_Common/Content/SharedEMReplicate/Customize%20Tasks/store_changes_settings.htm#:~:text=are%20not%20affected.-,Change%20Data%20Partitioning,%2D%20Specify%20the%20length%20(in%20hours%20and%20minutes)%20of%20each%20partition.,-Information%20note" target="_blank" rel="noopener">Change Data Partitioning</A> is supported in the 3 Hadoop endpoints, an example of turn on <FONT face="courier new,courier">Change Data Partitioning</FONT>: (in below example the partition is switching every 10 minutes,It is <A title="recommended to specify a partition length in excess of one hour." href="https://help.qlik.com/en-US/replicate/November2023/Content/Global_Common/Content/SharedEMReplicate/Customize%20Tasks/store_changes_settings.htm#:~:text=It%20is%20recommended%20to%20specify%20a%20partition%20length%20in%20excess%20of%20one%20hour.%20Although%20specifying%20a%20partition%20length%20less%20than%20one%20hour%20may%20improve%20latency%2C%20creating%20many%20partitions%20on%20the%20target%20may%20also%20impact%20(target)%20performance%20(especially%20in%20systems%20with%20large%20volumes%20of%20changes)." target="_blank" rel="noopener">recommended to specify a partition length in excess of one hour.</A>)</P> <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="john_wang_0-1709454763033.png" style="width: 999px;"><img src="https://community.qlik.com/t5/image/serverpage/image-id/161157i2CF10039EE046511/image-size/large?v=v2&amp;px=999" role="button" title="john_wang_0-1709454763033.png" alt="john_wang_0-1709454763033.png" /></span></P> <P>Hope this helps.</P> <P>John.</P> <P>&nbsp;</P> Sun, 03 Mar 2024 08:37:31 GMT https://community.qlik.com/t5/Qlik-Replicate/Using-Parquet-format-in-HDFS-as-the-target/m-p/2426245#M9954 john_wang 2024-03-03T08:37:31Z