The Replicate tool writes data to disk in a couple different scenarios:
When using Logstream endpoint
When the transactions exceed the set memory limit
Replicate takes care of deleting the data once it has sent it to the target.
I would like to propose an enhancement for Replicate to use secure delete tools such as shred while deleting data. This is part of our security best practices as well a PCI-DSS requirement.
@Shelley_Brennan : Can you please let us know on the next steps or process work flow for enhancements requested ? This is a follow-up item from PCI-DSS requirement and we need to provide an action plan or remediation strategy soon.
There are no plans to implement this enhancement at this time. However, we will continue to collect feedback from others and will keep it under consideration as we do our future planning.
I would like to propose an enhancement for Replicate to use secure delete tools such as shred while deleting data. This is part of our security best practices as well a PCI-DSS requirement.
Replicate uses the native remove/unlink (and also DeleteFile on Windows) APIs to delete files that are no longer in use. Replicate also uses 3rd party components that use files and delete them using the same APIs. Those APIs, by themselves, do not wipe the stored data from storage which is why Qlik recommends that customers always used encrypting file systems.
The proposal to have an addon to Replicate that will be called instead of the above mentioned APIs is not practical - it would not solve the problem even if implemented as proposed.
Reasons include:
Replacing API call with running a custom command (e.g. sdelete on Windows or scrub on Linux) will result in significant overhead and delays because it will be must slower than calling the API (Replicate creates a deletes large number of files with data during its operation).
The only universally applicable solution that would guarantee no sensitive data is ever found on storage devices (of any kind) is the use of encrypting file systems (as mentioned above).
NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.