<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>idea ComposeDL Fined Grained control for loading tables in Suggest an Idea</title>
    <link>https://community.qlik.com/t5/Suggest-an-Idea/ComposeDL-Fined-Grained-control-for-loading-tables/idi-p/1783911</link>
    <description>&lt;P&gt;This request is to have finer controls for re-setting / reloading data for a specific table.&amp;nbsp; The new integration with Rep for a full / re- load is great, but in general selectively processing a table is an issue in ComposeDL today and in gen2.&amp;nbsp; &amp;nbsp;&lt;/P&gt;&lt;P&gt;For example - if I have the a scenario where I have to alter a single tables definition (lets say I add a calculated column or add a column to the PK and I have the initial full load and history available in the CT ).&amp;nbsp; &amp;nbsp; &amp;nbsp;&lt;/P&gt;&lt;P&gt;I need to reload data from the full load / CT data for 1 table, I would have to create a new / special FULL LOAD process, special CDC process and then sink up the 2 CDC tasks.&amp;nbsp; &amp;nbsp;This is a pain in a real world production environment as you typically can't just go into prod and start creating new tasks.&amp;nbsp; &amp;nbsp;&lt;/P&gt;&lt;P&gt;Currently Compose pulls the MAX(partition) from the cmps_status table for the entire task.&amp;nbsp; Instead of processing based on the task, we should process based on the individual TABLE.&amp;nbsp; &amp;nbsp;This would allow a process where I could reset the partition names in the cmps_status table to force a reload of a single table WITHOUT having to perform a full load in Replicate.&amp;nbsp; &amp;nbsp; &amp;nbsp;&lt;/P&gt;&lt;P&gt;Akin to what happens in the "Collect entities with LOADED data" - but perform that same logic with "collect entities with changed data".&lt;/P&gt;&lt;P&gt;Along with this - it would be great if the CDC load could detect FULL LOADS for NEW TABLES in the ETL task and not just those that have already been processed.&amp;nbsp; &amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;This would go along way to improve operational running of Compose - adding new tables through deployment and controling table loads if needed.&amp;nbsp; (One big complaint from customers who dropped ComposeDL was that operational / deployment etc of C4DL was painful).&lt;/P&gt;</description>
    <pubDate>Thu, 18 Feb 2021 15:48:47 GMT</pubDate>
    <dc:creator>TimGarrod</dc:creator>
    <dc:date>2021-02-18T15:48:47Z</dc:date>
    <item>
      <title>Re: ComposeDL Fined Grained control for loading tables - Status changed to: Open - On Roadmap</title>
      <link>https://community.qlik.com/t5/Suggest-an-Idea/ComposeDL-Fined-Grained-control-for-loading-tables/idc-p/1822968#M6781</link>
      <description>&lt;P&gt;Thank you for the suggestion. This was added to the roadmap.&lt;/P&gt;&lt;P&gt;(SRB)&lt;/P&gt;</description>
      <pubDate>Mon, 19 Jul 2021 07:47:31 GMT</pubDate>
      <guid>https://community.qlik.com/t5/Suggest-an-Idea/ComposeDL-Fined-Grained-control-for-loading-tables/idc-p/1822968#M6781</guid>
      <dc:creator>Tzachi_Nissim</dc:creator>
      <dc:date>2021-07-19T07:47:31Z</dc:date>
    </item>
    <item>
      <title>Re: ComposeDL Fined Grained control for loading tables - Status changed to: Closed - Declined</title>
      <link>https://community.qlik.com/t5/Suggest-an-Idea/ComposeDL-Fined-Grained-control-for-loading-tables/idc-p/2020895#M11535</link>
      <description>&lt;P&gt;This is no longer planned for implementation&lt;/P&gt;</description>
      <pubDate>Fri, 30 Dec 2022 17:02:16 GMT</pubDate>
      <guid>https://community.qlik.com/t5/Suggest-an-Idea/ComposeDL-Fined-Grained-control-for-loading-tables/idc-p/2020895#M11535</guid>
      <dc:creator>TimGarrod</dc:creator>
      <dc:date>2022-12-30T17:02:16Z</dc:date>
    </item>
  </channel>
</rss>

