topic Re: Loading more than 1 million of Rows from Database Crashes in QlikView

Loading more than 1 million of Rows from Database Crashes

Tue, 25 Feb 2014 10:20:06 GMT

With a small database the report works but going to production with millions of rows after reading more than 1 million it says:

OLEDB read failed

InputTable:

SQL SELECT etc.

Re: Loading more than 1 million of Rows from Database Crashes

Anonymous — Tue, 25 Feb 2014 15:13:24 GMT

Miguel

I'd suggest your first check :

Does your Dev & Production run on different servers ?

Are the correct database clients installed on the Production Server ?

Using different AD Accounts ?

Does the Production user have correct rights ?

Best Regards, Bill

Re: Loading more than 1 million of Rows from Database Crashes

Tue, 25 Feb 2014 15:15:18 GMT

Also take a look if there is no firewall in the middle that is kicking the connection out...

Re: Loading more than 1 million of Rows from Database Crashes

Tue, 25 Feb 2014 15:59:01 GMT

Actually I'm running on local machine and just changed the connection string to use a remote database instead of my local test database, which is a small one.

Re: Loading more than 1 million of Rows from Database Crashes

greg-anderson — Tue, 25 Feb 2014 16:42:36 GMT

I agree with the others. This appears to be a connection issue, rather than a matter of data size. Make sure your ODBC drivers and connection parameters are identical, and check for firewall issues.

Re: Loading more than 1 million of Rows from Database Crashes

Tue, 25 Feb 2014 16:58:31 GMT

So why does it only fail after reading 1 million of rows?

Re: Loading more than 1 million of Rows from Database Crashes

Tue, 25 Feb 2014 16:59:23 GMT

The OBCD drivers are the same, I told you that I'm using my local machine.

Re: Loading more than 1 million of Rows from Database Crashes

chiru_thota — Tue, 25 Feb 2014 17:05:45 GMT

We also faced the same issue.Because after certain time your connection to data base will be time out.

That depends on your database settings and you can check with DBA.

work around we have used.

Let us say your table has two years data 2013,2014.load the data in two steps while creating a QVD.

connect connection string;

load * from table where year =2013

disconnect;

connect again

load * from table where year =2014;

Re: Loading more than 1 million of Rows from Database Crashes

greg-anderson — Wed, 26 Feb 2014 11:43:08 GMT

Mahesh, did Chranjeevi's suggestion work? I ask because I will undoubtedly face this problem at some point in the future.

I do hope you get a successful data load!

Re: Loading more than 1 million of Rows from Database Crashes

Wed, 26 Feb 2014 12:01:05 GMT

So just added a connection timeout of 30 seconds to the connection string on the client and it worked.

something like:

Initial Catalog=MY_DB;Connection Timeout=30;