idea Re: Postgres Partitions Replication To Snowflake in Suggest an Idea

Postgres Partitions Replication To Snowflake

ppatelquilk — Fri, 19 Feb 2021 21:22:12 GMT

Hello:

Just found out that when replicating from Postgresql with partitions to Snowflake missing basic functionality.

on target Snowflake data gets copied from source Postgres partitions to target snowflake partitions, on target data can't be queried from parent table. To get latest data have to query latest partition not the parent table. it works fine when source is Oracle.

Re: Postgres Partitions Replication To Snowflake - Status changed to: Open - New

Shelley_Brennan — Mon, 08 Mar 2021 19:36:05 GMT

Thank you for your post. We have a couple of questions about your request.

What version of PostgreSQL are you running?

Have you have opened a related Support case about this issue? If so, could you share the case number so we can review?

And finally, is your request to overcome this limitation which exists when using Parallel Load feature with PostgreSQL source:

Table segmentation by partitions or sub-partitions is not supported with the PostgreSQL source endpoint.

Re: Postgres Partitions Replication To Snowflake - Status changed to: Closed - Declined

Shelley_Brennan — Mon, 03 May 2021 13:17:13 GMT

We'll need more information to reconsider this request - thank you.

Re: Postgres Partitions Replication To Snowflake

ppatelquilk — Tue, 04 May 2021 19:47:29 GMT

Hello:

we are using aurora postgres 11.9

Yes we opened support case and recommended to submit idea.

Re: Postgres Partitions Replication To Snowflake

Shelley_Brennan — Wed, 05 May 2021 17:58:04 GMT

Could you share the support case number? Also, could you answer the question above to clarify the exact limitation you are trying to overcome? Thank you!

Re: Postgres Partitions Replication To Snowflake

ppatelquilk — Wed, 05 May 2021 18:26:33 GMT

Hi Shelley,

Here is a case no.

02145134 - TABLE IS NOT GETTING UPDATED

The problem we try to overcome with this is it should work without any work around.

Like Oracle when query parent table should return rows from all partitioned tables.

In postgres it doesn't.

Thanks.