topic Re: How to Reduce to Application Size Without Splitting in App Development

How to Reduce to Application Size Without Splitting

Sunilkumar3 — Mon, 12 Aug 2024 14:03:20 GMT

Below are the Details:

1) We have Developed Snowflake Schema Data Model.

2) We are using only Required Fields.

3) Currently we have application Size is 1.9 GB and Base memory footprint Size is more than 5 GB.

4). So, we wanted to Reduce Base memory Size less than 5 GB.

5) We can't Split the Application based on the year or Dimension Because user want to See all years Data in One Application.

Re: How to Reduce to Application Size Without Splitting

Or — Mon, 12 Aug 2024 14:15:41 GMT

Check if you've optimized all fields (make sure they are correctly formatted, that numbered keys are used instead of concatenated strings, that timestamp fields are split into date and time, etc.)

I'd be surprised if that'll get you under 5GB, though, unless your app is super bloated. It sounds like you just have too much data in one place.

Re: How to Reduce to Application Size Without Splitting

paulcalvet — Mon, 12 Aug 2024 14:10:48 GMT

Hello,

Check if you don't have string field in the fact table, only integer/decimal or date :

Use autonumber on all your key fields with :

set HidePrefix = '%';
Autonumber '$(HidePrefix)KEY_*';

Re: How to Reduce to Application Size Without Splitting

Sunilkumar3 — Mon, 12 Aug 2024 14:24:51 GMT

Hi thanks for the Update. The Points which you have Highlighted which we have already taken care.

Re: How to Reduce to Application Size Without Splitting

Or — Mon, 12 Aug 2024 14:26:49 GMT

@paulcalvet wrote:

Hello,

Check if you don't have string field in the fact table, only integer/decimal or date :

Just a quick response to this - it has almost no impact on the application size / memory footprint. Because of the way Qlik stores information, it doesn't really matter if you keep strings in your fact table.

Load RowNo() as Row, Rand() as Random, 'This is a text string' & Mod(RowNo(),10000) as String Autogenerate(10000000);

Load RowNo() as Row, Rand() as Random, Autonumber('This is a text string' & Mod(RowNo(),10000)) as Key Autogenerate(10000000);

Load Autonumber('This is a text string' & Mod(RowNo(),10000)) as Key, ('This is a text string' & Mod(RowNo(),10000)) as String Autogenerate(10000);

Results in a 30KB size difference for a 90MB file.

Re: How to Reduce to Application Size Without Splitting

Or — Mon, 12 Aug 2024 14:28:17 GMT

Then you're going to have to reduce the number of fields, or reduce the number of records, or reduce the contents of fields to make the app smaller.

You could consider using an ODAG approach to let the user pick which subset of the data they want, rather than using the entire large app for everything.

Re: How to Reduce to Application Size Without Splitting

Kushal_Chawda — Mon, 12 Aug 2024 14:59:24 GMT

@Sunilkumar3 If possible try to reduce data in your application. There are many ways to do it. You can filter your data or you can aggregate your data if your data is at lower granular (transaction) level. Once you aggregate your data, you can use ODAG to go to lower level in transaction. Check which field is occupying more memory using App metadata anlyzer app. If that field is just used in measure calculation, try to apply autonumber function on it.

Re: How to Reduce to Application Size Without Splitting

marcus_sommer — Mon, 12 Aug 2024 15:43:25 GMT

Beside the other suggestions you may consider to use different granularities within your facts - see:

Fact Table with Mixed Granularity - Qlik Community - 1468238

Re: How to Reduce to Application Size Without Splitting

rwunderlich — Mon, 12 Aug 2024 23:07:22 GMT

It sounds like you done all the right things. Hard to make further suggestions without seeing the app. Use a tool like QSDA Pro to identify what are the largest fields and look at making them smaller or eliminating the need for the field altogether.

-Rob

Re: How to Reduce to Application Size Without Splitting

ali_hijazi — Tue, 13 Aug 2024 07:33:56 GMT

use QSDA to see if there are unused fields
then you can drop them ; this has quiet good impact on the size of the app