Skip to main content
Announcements
Qlik and Talend Support Cases are now opened in the same place.

Loading a big table in Qlik Replicate

No ratings
cancel
Showing results for 
Search instead for 
Did you mean: 
David_Fergen
Former Employee
Former Employee

Loading a big table in Qlik Replicate

Last Update:

Feb 2, 2022 6:34:42 AM

Updated By:

Sonja_Bauernfeind

Created date:

Aug 26, 2020 11:36:07 AM

To load a big table in Qlik Replicate follow these steps:

  1. Create a view for each partition on the source: 
    select 'CREATE OR REPLACE VIEW ' || table_owner || '.' || 'SALES_VIEWS_' || PARTITION_NAME || 
    
    ' AS SELECT * FROM ' || table_owner || '.' || TABLE_NAME ||  ' PARTITION(' || PARTITION_NAME || ');' 
    
    from dba_tab_partitions 
    
    where table_owner = 'SH' 
    
    AND TABLE_NAME = 'SALES'; 
  2. Add the table to the existing task and set error handling to upsert. The table will start getting the changes.
  3. Create a new task (full load only) and just select the views that were created. This will create table on target with same name as view. Then crank up the number of tables loading in parallel until it squeals.  
  4. As each view loads merge the corresponding view_table on the target to the base table. They could use a merge syntax that would only copy rows that do not exist. 
Labels (2)
Version history
Last update:
‎2022-02-02 06:34 AM
Updated by: