Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
johanfo2
Creator
Creator
‎2021-03-04 03:43 PM

Postgresql loading is slow

Hi,

I have a huge table of 120M rows (40 columns) postgresql that I am able to dump to CSV on the Qlik sense host by using 'psql \copy' in 17 minutes. However, using the default postgresql connector in the latest Qlik sense (2021 Feb sp1)  it seem to take around 5 hours.  Why, I am not sure, but I get the feeling that the postgresql connector is outdated or misconfigured.

The machine is 16core 80gb, the load query is as simple as it gets. Load *; select X,y,z,,, from table;

Anyone else using postgresql and Qlik sense with big data?

Labels (2)
Labels
892 Views
0 Likes
1 Reply
johanfo2
Creator
Creator
‎2021-03-08 04:24 PM
Author

Can add that this occurs on Postgresql 13.2.  I "solved" this by installing the ODBC driver, and configuring that with a larger fetch size, then connecting QS to ODBC instead. 

848 Views
0 Likes