Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
hi all
in my model i use Qlik - Snowflake ODBC connector
load time from Snowflake source through ODBC connector are dramatically slow -
is someone familiar with this or any solution to improve load time ?
advanced thanks
Hello,
I am willing to help, but it may take more than one comment. Please do the following:
1. Go to the node that is running the load.
2. Open up performance monitor (quicker: https://www.windowscentral.com/how-use-performance-monitor-windows-10
3. Kick off the load and monitor the resources
Please tell me what you see. Do you see Memory hitting 100%, CPU, Networking or Disk, Something else?
Good Luck -
hi @Qlik_Administrator_Dude , you mean to open performance monitor while connected to snow flake (loading from QV) ?
Hello,
When running queries, what is the hardware acting like?
Check your Network IO, Ram, CPU. All of these can be seen from Windows Resource Monitor. If all of your hardware is working fine (I.E no visible bottlenecks), it could be a query that is just taking too long. If you can identify a bottle neck, like Disk IO for instance, it could be virtual memory, or some other cache. See if you can identify what is writing (Postgres for instance would be super interesting)...
Examples of bad quires are 'Select *'. There are other examples, but in a nutshell, you don't want to call a bunch of data, put it in memory, and then filter. It is much more efficient to simply filter in the query to put less into memory.
I hope that helps you understand the method to the madness. Please let me know if I can help further. Good luck -