Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

SELECT * through ODBC connector (MariaDB) is very slow - how to optimise ?

Hi,

I would like to select all rows from table (from a MariaDB database), and store them into a .qvd file.

My script looks like this :

ODBC CONNECT TO [MariaDB odbc];

SQL SELECT * FROM `my_table`;

STORE "MY TABLE" INTO C:\(...)\data.qvd;

Unfortunately, this table contains more than 4 millions of rows. And selecting all of them with Qlikview is very slow.

I let this query, SELECT *, running for more than 18 hours : it selected only 1,8 million of rows.

Do you happen to know some ways to optimize the query ? Letting this script running for a week to select 4 millions of row is not a solution.

------------

Here are some technical informations :

OS → Windows Server 2012 R2

MariaDB → ver. 10.2.6, is localhost

Qlikview → ver. 12.0.20200.0 SR3 64-bit Edition

ODBC driver → tested with ver. 2.0.15 and 3.0.0 (alpha), but that's the same / 64_bit

7 Replies
m_woolf
Master II
Master II

Have you tried OLEDB?

Anonymous
Not applicable
Author

do you read the whole table each time? why?

tomasz_tru
Specialist
Specialist

How long does it take to run this query in shell?

krishnacbe
Partner - Specialist III
Partner - Specialist III

Avoid using Select * option, Pull the fields that you are using in Dashboard.

Not applicable
Author

Well, I didn't know enough about OLE DB to try it, but it was worth trying after your post.

Now, it takes "only" 2 minutes and 40 seconds to scan the whole table ! Thanks !

By the way, I use "Microsoft OLE DB Provider for ODBC Drivers".

Not applicable
Author

It takes less than 3 seconds to SELECT * using MariaDB CLI

Not applicable
Author

Unfortunately, the database already contains only needed informations. In other words, every field is useful.