topic How to do Parallel load using Partitions - Oracle Source to Snowflake in Qlik Replicate

How to do Parallel load using Partitions - Oracle Source to Snowflake

nabeelaslam1994 — Thu, 25 May 2023 13:23:19 GMT

Hello Team,

I am trying to load a huge table i.e. 2.6 billion records in chunks. I do have partitions on the source table named Q1_2010, Q2_2010 etc... When i use it in Qlik replicate, It runs and completes but does not loads the data to snowflake. Please guide. Please see the attachment to see how i specified.

Nabeel

Re: How to do Parallel load using Partitions - Oracle Source to Snowflake

nabeelaslam1994 — Thu, 25 May 2023 13:24:16 GMT

Even using sub-partitions, It does not loads anything.

Re: How to do Parallel load using Partitions - Oracle Source to Snowflake

Clever_Anjos — Thu, 25 May 2023 16:07:59 GMT

Did you use the option "use all data partitions"?
When you disable the Parallel Load the data is loaded in Snowflake?

Re: How to do Parallel load using Partitions - Oracle Source to Snowflake

nabeelaslam1994 — Thu, 25 May 2023 21:43:46 GMT

I was able to run the "specify partitions" option. I am facing another issue now. The task comes to very end and when it is near to completion, It fails with the following error. It commits 99% of the rows to snowflake and there is always some 100k rows missing.

Re: How to do Parallel load using Partitions - Oracle Source to Snowflake

Dana_Baldwin — Thu, 25 May 2023 22:42:03 GMT

Hi @nabeelaslam1994

The screen capture shows an Oracle error. It seems the connection is being terminated outside of Qlik Replicate. This link may help you find and resolve the issue:

ORA-03135 Connection Lost Contact Tips (dba-oracle.com)

Hope this helps.

Dana