Qlik Community

Ask a Question

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
QlikWorld Online 2021, May 10-12: Our Free, Virtual, Global Event REGISTER TODAY

Add data warehouse function to reinitialize the table[s] for a given entity or group of entities

plexpro52
Creator
Creator

Add data warehouse function to reinitialize the table[s] for a given entity or group of entities

There have been a number of occasions when after introducing an entity into the data warehouse model, and developing the data load process, where I have needed to change an approach or correct an error, and the ideal thing to do would have been to purge the table[s] (since there can be satellite tables involved, and also load error tables) back to pristine state, as created by Compose with various required null records, etc.

However, neither support nor I have been able to find a way to do this natively; usually I end up dropping the whole data warehouse, and recreating it and reloading it from scratch.

So far, this has not been fatal, but soon we will start to keep row history in the warehouse, and this process would mean losing all of our history.

Please, Compose needs a function to reinitialize the table[s] for a given entity or group of entities.

2 Comments
Nisarh
Contributor
Contributor

We are in the initial stage of Development and this will be a huge issue for us after production deployment. We definitely do not want to lose history in the WH tables. This is a must have for us.

Thanks!

Tzachi_Nissim
Employee
Employee

Hi,

The reason there is no support for dropping a single entity or several select entities because when reloading these entities there is no guarantee that the surrogate key of records will be preserved. Since other entities could include a relationship to the dropped entity with the surrogate key stored for that relationship, reloading could result in incorrect relationships.

A way to work around this would be to preserve the business-key to surrogate key mapping in the hub and then reload the table. This is obviously more complex than just drop&create. I'm opening this up for community feedback and voting.

Regards,

Tzachi

Status changed to: Open - Collecting Feedback