Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
This page is no longer in use. To suggest an idea, please visit Browse and Suggest.

Compose for Data Lakes behavior when the source primary key value change

sanlamZA
Contributor
Contributor

Compose for Data Lakes behavior when the source primary key value change

Our Cloudera DataLake holds data from various sources with no insight or control on the source data changes.

Currently when changing a Primary Key value in the source record it will cause a new record to be inserted in the storage table.

 

Due to this behavior our BI environment displays an huge amount of duplicate values when selecting from the storage base table or the current view.

We have a need for this behavior to change. A possible solution maybe to have a header deleted  value for the before image.

Thanks

Janine

Tags (1)
3 Comments
Abrie_M
Contributor III
Contributor III

Good day 

 

Any update on this request?

 

Thanx

Abrie Marais

Tzachi_Nissim
Employee
Employee

Thank you. We are looking at addressing this in Replicate by turning the BEFOREIMAGE+UPDATE into a DELETE+INSERT when a PK change is involved. This is a relatively high priority item. I am putting this into "Collecting feedback" until we formally have this in the plan.

Status changed to: Open - Collecting Feedback
Meghann_MacDonald

This feature has been delivered in Qlik Replicate November 2022. Thank you for your contributions! Qlik Replicate can now deliver a PK update as a DELETE (prior key) and INSERT (new key) pair. Review the configuration - https://help.qlik.com/en-US/replicate/May2023/Content/Global_Common/Content/SharedEMReplicate/Custom...

Status changed to: Delivered