Qlik Community

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
Now Live: Qlik Sense SaaS Simplified Authoring – Analytics Creation for Everyone: READ DETAILS

PostgreSQL partitioned tables replication should read sub-table without explicitly adding those sub tables

mehulthakkar
Contributor II
Contributor II

PostgreSQL partitioned tables replication should read sub-table without explicitly adding those sub tables

When replicating tables from PostgreSQL as a source, it requires to select all partitioned sub-tables be added during table selection at design time.  PostgreSQL information schema already includes parent and all sub-tables detail for these partitioned tables.  I am thinking if replicate task has out of the box support to read all sub-tables without explicitly adding them in the task and writing to a single table at target database/system.

We have a scenario where our tables are daily partitioned and these partitioned are kept for 90 days, in this case if we have 15 tables, for example, it will include all partitions for all 15 tables that is 1350 tables added to the task.  This limits how many user facing tables (parent tables) we can include in the task that can be supported without impacting any performance of a task or support team.

currently we have handled this scenario by leveraging table selection pattern and global transformation to rename target table to parent table.

Tags (2)