Trouble loading data in qlik sense (data structure and load problem)

[vid_pajek]

Hi guys,

I've been developing a qlik sheet for software analytics and have some trouble loading data into qlik sense.

We are collecting analytics data from our desktop app. Major events get sent when users use our program.

I get all my data from a .qvd file which is updated daily. all data gets uploaded into a large table with empty values where needed.

so my data structure looks something like this:

So to summerize,

I get all my data from a single .qvd file which is uploaded daily, all columns from the general section are populated 100% where other columns are populated only with a corresponding event (event name).

I've tried to load this data model into qlik sense with some moderate in different ways:

- Loading tables as you see above separately with a where clause the PK was intended to be ID:
this did not work as too many synthetic keys were generated and app crashed. (it currently has 4m rows and is getting rapidly bigger). Some subtables had the same name (for instance source welcome screen and activate product subtables).

- Loading a large main table and only ID's in subtables with where clauses:

The intention was to get rid of synthetic keys but that did not work

- Loading a main table in background and loading other tables with resident load:
Didn't work

- Loading only 1 table with empty cells.
This worked, but was is very cumbersome as I have to write excessive set analyst expressions, furthermore with some filters applied the app returns wrong data.

I'm currently looking into loading my data with hierarchy but as far as I understand it my model is not hierarchical, I'm quite new at this. so any information would be helpful as to how I should load my data so that I get as few headaches down the line as possible.