Partitioning of table with delta as a connector

[chandraprakash_j_volvo]

Source: Oracle DB

Target: Databricks Delta connector

We created one task which migrate 38 tables. Few table are very large and we receive data continuously. So we need to partition the table before loading it into the target. We need to partition the table based on specific column for tables and partition by date for few tables.  Is there a way to do in  qlik replicate?

[DesmondWOO]

Hi @chandraprakash_j_volvo ,

Thank you for reaching out to the Qlik Community.

Please check the topic 'Parallel Load' to see if it helps.

Regards,
Desmond

[chandraprakash_j_volvo]

Seems we cannot use parallel load for Databrcick lakehouse(Delta). Is there any other way to do it?

[DesmondWOO]

Hi @chandraprakash_j_volvo ,

Replicate does not support parallel load for Databrick Delta. How about if you create multiple full load tasks and run simultaneously?

Regards,
Desmond 

[chandraprakash_j_volvo]

Is there a way to do partition by a specific column without using parallel load and without creating a new task?

[SushilKumar]

Hello @chandraprakash_j_volvo ,

parallel load (initial load ) populates the data into target data . without parallel load no data will be pushed to target side.

Regards,

Sushil Kumar

[DesmondWOO]

Hi @chandraprakash_j_volvo ,

Unfortunately, it seems that this cannot be done.

Regards,
Desmond