idea Re: Columnstore indexes support in Suggest an Idea

Columnstore indexes support

sidneyb — Wed, 23 Sep 2020 20:59:26 GMT

Columnstore indexes are the standard for storing and querying large data warehousing fact tables.
Microsoft recommends usage of columnstore indexes for large tables in data warehouses as it helps to improve query performance.

As data stored on data warehouses based on SQL Server are being moved to cloud and streaming platforms it will be great if Qlik Replicate can support column store indexes for SQL Server endpoint.

Re: Columnstore indexes support - Status changed to: Open - New

Ola_Mayer — Mon, 19 Oct 2020 12:33:58 GMT

Can you please clarify if are asking for support on the source or target?

Re: Columnstore indexes support

sidneyb — Mon, 19 Oct 2020 20:17:08 GMT

The feature request is related to SQL Server as source endpoint, as the columnstore is recommended by Microsoft for tables that need to handle large data volumes.

Re: Columnstore indexes support

jbennett1 — Mon, 26 Oct 2020 15:21:07 GMT

This is an issue for our company. We are trying to replicate from MS SQL to Oracle and cannot from tables with columnstore indexes. I hope this gets fixed or there is a work around.

Re: Columnstore indexes support

jbennett1 — Mon, 26 Oct 2020 15:26:14 GMT

Can we replicate from a view that refers to a table that has a columnstore index? is this a work around? or maybe an indexed view? or in either case, the server will access the table and fail due to the underlying columnstore index?

Re: Columnstore indexes support

jbennett1 — Mon, 26 Oct 2020 15:29:21 GMT

I wonder if Qlick replicate can pull from a view or query instead, where we can tell it to ignore the columnstore index (https://blog.sqlauthority.com/2011/10/30/sql-server-how-to-ignore-columnstore-index-usage-in-query/).

Re: Columnstore indexes support - Status changed to: Open - Collecting Feedback

Ola_Mayer — Mon, 02 Nov 2020 14:29:24 GMT

Re: Columnstore indexes support

JarleMeland — Wed, 18 May 2022 06:37:38 GMT

@Ola_Mayer We're having the same problems as described by the other users here, and it's currently blocking us from running replication on a couple of large tables. Would be great if Qlik could support columnstore indexes on SQL Server sources.

Has anyone found a good workaround?

Re: Columnstore indexes support

bobvecchione — Wed, 18 May 2022 12:39:16 GMT

Hi - Ola is no longer the Replicate PM, but I will discuss with R&D and report back. To be clear, as of now this is not on our roadmap though.

Thanks the request

--bobv--

Re: Columnstore indexes support

JarleMeland — Wed, 18 May 2022 12:53:45 GMT

@bobvecchione , thanks for the reply.

I would also like to know why it's not supported if that's at all possible 🙂

I totally understand if you cannot replicate the index itself - but I would like to have the data. Seeing as Qlik Replicate is using MS Replication - I do not see a blocker on the MS side of things.

Re: Columnstore indexes support

bobvecchione — Wed, 18 May 2022 12:56:41 GMT

We will check...also, we recently added support for the MS-CDC API for Azure SQL (MI &DB) and are now certifying it on SQLServer. This may also be an option.

From now on, please track this idea from the Ideation por...

Meghann_MacDonald — Wed, 02 Aug 2023 15:12:42 GMT

From now on, please track this idea from the Ideation portal.

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.

Re: Columnstore indexes support - Status changed to: Closed - Archived

Ideation — Wed, 02 Aug 2023 15:12:44 GMT