topic Re: Rows fetched during load in QlikView

Rows fetched during load

Mon, 02 Dec 2013 16:57:34 GMT

HI, I have 2 newbie questions:

I a load script that should only about 1000 rows from a qvd file. When I execute the load, it tells me that over 4,000,000 rows are 'fetched'. When I check the table viewer after the load the corresponding table shows me that it does correctly have only about 1000 rows in it.

1 - Does the message in the output log really mean it 'scanned' over 4,000,000 rows but only loaded in about 1000? Or is it somehow actually fetching all that data to memory first?

I'm asking because while my data set in the table is correct, I have several load scripts in my document that give this same message so potentially could have 30 million rows 'fetched' and now I'm starting to get 'Object memory failed' errors when setting up some expressions in a chart object and clicking some data selections that should include most data I have. I was thinking I don't have alot of data loaded so why am I getting 'object memory failed' messages so want to make sure I understand what the load output log is telling me.

2 - What are the typical reasons for getting the 'object memory failed' messages when working with chart objects in a document?

Thanks in advance!

Re: Rows fetched during load

Anonymous — Mon, 02 Dec 2013 17:07:15 GMT

Check your joins. Maybe you're creating Cartesian product...

Re: Rows fetched during load

Anonymous — Mon, 02 Dec 2013 18:04:31 GMT

Cindy

Could you share the log file from the reload. It should be in the same folder as your qvw with a .log extension.

If it is not there then check under Settings | Document Properties that Generate Logfile is ticked & reload again to get the log file.

Best Regards, Bill

Re: Rows fetched during load

Clever_Anjos — Mon, 02 Dec 2013 19:44:00 GMT

Please post your script

Re: Rows fetched during load

Tue, 03 Dec 2013 06:34:07 GMT

Hi, sorry for the delayed response, my internet was down most of the day today, good ol ATT, anyway...

Bill, I was not logging so turned that on as you suggested - very useful, thanks.

I was doing a LEFT KEEP to minimize what was retrieved from one table to the next and have read to switch it all to EXISTS in the where clause instead. I did this and am now getting the right numbers in the 'FETCHED' count as well as the final table rows.

Thank you.