idea Re: Secure delete data in Replicate - Status changed to: Open - Collecting Feedback in Suggest an Idea

Secure delete data in Replicate

Prabodh — Thu, 04 Feb 2021 16:28:28 GMT

The Replicate tool writes data to disk in a couple different scenarios:

When using Logstream endpoint
When the transactions exceed the set memory limit

Replicate takes care of deleting the data once it has sent it to the target.

I would like to propose an enhancement for Replicate to use secure delete tools such as shred while deleting data. This is part of our security best practices as well a PCI-DSS requirement.

Re: Secure delete data in Replicate - Status changed to: Open - Collecting Feedback

Shelley_Brennan — Mon, 22 Feb 2021 13:20:57 GMT

Thank you for the suggestion. We would like to collect feedback from others as well.

Re: Secure delete data in Replicate

birendodia — Mon, 13 Sep 2021 16:08:49 GMT

@Shelley_Brennan : Can you please let us know on the next steps or process work flow for enhancements requested ? This is a follow-up item from PCI-DSS requirement and we need to provide an action plan or remediation strategy soon.

Re: Secure delete data in Replicate

Shelley_Brennan — Tue, 21 Sep 2021 15:43:00 GMT

There are no plans to implement this enhancement at this time. However, we will continue to collect feedback from others and will keep it under consideration as we do our future planning.

Re: Secure delete data in Replicate

DrorHarari-Qlik — Thu, 27 Apr 2023 00:45:21 GMT

I would like to propose an enhancement for Replicate to use secure delete tools such as shred while deleting data. This is part of our security best practices as well a PCI-DSS requirement.

Replicate uses the native remove/unlink (and also DeleteFile on Windows) APIs to delete files that are no longer in use. Replicate also uses 3rd party components that use files and delete them using the same APIs. Those APIs, by themselves, do not wipe the stored data from storage which is why Qlik recommends that customers always used encrypting file systems.

The proposal to have an addon to Replicate that will be called instead of the above mentioned APIs is not practical - it would not solve the problem even if implemented as proposed.

Reasons include:

Replacing API call with running a custom command (e.g. sdelete on Windows or scrub on Linux) will result in significant overhead and delays because it will be must slower than calling the API (Replicate creates a deletes large number of files with data during its operation).
The common secure delete utilities were written for HDDs (rotating disks) and do not really guarantee the wiping of the data when using SSDs on when using virtualized storage or remote storage. See https://www.howtogeek.com/234683/why-you-cant-securely-delete-a-file-and-what-to-do-instead/ for a nice writeup on this topic.

The only universally applicable solution that would guarantee no sensitive data is ever found on storage devices (of any kind) is the use of encrypting file systems (as mentioned above).

From now on, please track this idea from the Ideation por...

Meghann_MacDonald — Wed, 02 Aug 2023 16:26:05 GMT

From now on, please track this idea from the Ideation portal.

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.

Re: Secure delete data in Replicate - Status changed to: Closed - Archived

Ideation — Wed, 02 Aug 2023 16:26:06 GMT