The preload option has been created to move the excessive loading time of large or many documents from anywhere during the lifetime of a QVS run to the beginning (startup) of a QVS run, not to eliminate the loading time altogether. That way, your users won't have to wait too long for a published document on a running QVS to open. But the QVS startup time will take longer.
Do you think that those 20 seconds are way too much for the size of your preloaded documents vs the speed and amount of RAM of your server?