topic Drop data after Binary Load (application size is not reduced) in QlikView

Drop data after Binary Load (application size is not reduced)

asgardd2 — Thu, 18 Aug 2016 07:28:10 GMT

Hello!

After reloading via the binary load (second application), I droped unwanted data (tables, fields). But the size of the application is practically not reduced compared to the original application.

Note!! If I do not have current selections in second application and choose the option to reduce the data size - the application is substantially reduced. (i expect to see it after drop)

How i can fix it? I have one solution to fix it, but i think this is not right way:

1. Store Transaction table, then original application is reloading. (this table is very big)

2. After "Binary load" in second application i will drop this table and then load this table from qvd file.

Best regards,

Anton Aleksandrov.

Re: Drop data after Binary Load (application size is not reduced)

Gysbert_Wassenaar — Thu, 18 Aug 2016 07:30:45 GMT

Do you keep the file open after reloading or do you save the document, close it and only then look at the file size?

Re: Drop data after Binary Load (application size is not reduced)

asgardd2 — Thu, 18 Aug 2016 07:41:05 GMT

Yes, i save + close the document and then reopen it.

Re: Drop data after Binary Load (application size is not reduced)

Gysbert_Wassenaar — Thu, 18 Aug 2016 07:50:37 GMT

Ok, try this:

Just do a binary load and don't drop any tables. Then check the sizes of all the tables in the Document Properties. Specifically of the tables you want to drop. How significant is the size of those tables compared to the total of all tables?

Re: Drop data after Binary Load (application size is not reduced)

asgardd2 — Thu, 18 Aug 2016 08:54:24 GMT

I would like drop second table :

And drop some fields from first table:

(all values from export memory statistics)

Only now I do not understand why only after reducing the data (although none of the filters is not selected) application size decreases.

Re: Drop data after Binary Load (application size is not reduced)

Gysbert_Wassenaar — Thu, 18 Aug 2016 09:09:03 GMT

Well, no idea really. My guess is that the Reduce data action creates a new defragmentated file whereas a simple save after reload and dropping some tables doesn't do any defragmentation.

Re: Drop data after Binary Load (application size is not reduced)

asgardd2 — Thu, 18 Aug 2016 09:21:56 GMT

Perhaps this is true, I will have to use qvd file(main transaction table) in script.

Thank you!

Re: Drop data after Binary Load (application size is not reduced)

marcus_sommer — Thu, 18 Aug 2016 10:46:05 GMT

I think the reason of this behaviour is that no processing happened by the binary load then the datamodel will be simply transferred into the RAM and by dropping some tables/fields afterwards no real processing is triggered else only the metadata of the tables/fields are removed or maybe even only invisible.

Therefore the processing must be triggered in any way. Maybe it could be happen with some dummy load-statement like:

dummy: load 0 as dummy autogenerate 0;

drop table dummy;

or with a direct accessing a loaded table by loading or adding something and removing it again.

- Marcus

Re: Drop data after Binary Load (application size is not reduced)

asgardd2 — Thu, 18 Aug 2016 11:52:28 GMT

I used variant with the addition of a dummy field to the table, and then delete it.

Concatenate(Transactions)
load
    0 as dummy
Autogenerate 1;

DROP FIELD dummy;

After that, the application size has decreased.
Thank you!