Qlik Community

QlikView Layout & Visualizations

Discussion Board for collaboration on QlikView Layout & Visualizations.

kirman326
New Contributor

5 million Data loaded every day in the dashboard

Hi,

The requirement of our dashboard is to show the data in detail and summary tabs.

The count of data per day is approx. 5 Millions and in the dashboard we are showing the 15 days data.

So , the problem is , we are pulling in all the 5 Millions * 15 Days data in the details tab , due to which the performance of the dashboard is degrading and there is always a lag when we select any filters or move across the tabs.

Can you please provide some solution to tackle this problem ? As how we can optimize the performance.

Thanks

10 Replies
thornofcrowns
Valued Contributor II

Re: 5 million Data loaded every day in the dashboard

Save the data out to QVD(s) as a first step.

Re: 5 million Data loaded every day in the dashboard

Hi,

How many fields you have?

are you use complex calculation?

Is your machine hosted on VM?, If yes you need physical machine.

How much ram and CPU you have?

Regards

ASHFAQ

Not applicable

Re: 5 million Data loaded every day in the dashboard

Hi,

If you can't aggregate the data you should add calculation condicionals like selecting one day or something that filter your data in order to limit the number of rows. you can also add buttons also with tipical user filters.

I don't think the users need all the data at the same time.

Cheers,

David

mikkeltaylor
Contributor II

Re: 5 million Data loaded every day in the dashboard

I would also consider building a more aggreagted Dashboard file for fast performance and then have a separate Dashboard with the detailed data.   Use document chaining when the user needs to move from aggregated to detailed data.

Michael.

kirman326
New Contributor

Re: 5 million Data loaded every day in the dashboard

QVD is already setup.Thanks

kirman326
New Contributor

Re: 5 million Data loaded every day in the dashboard

There is no complex calculation involved , its the Raw data which is being dumped into the dashboard.

kirman326
New Contributor

Re: 5 million Data loaded every day in the dashboard

The data is filtered based on the dates. But the problem is each business day as 5 Million volume data.

kirman326
New Contributor

Re: 5 million Data loaded every day in the dashboard

Can you please guide me in implementing the Document Chaining?

pradeepreddy
Valued Contributor II

Re: 5 million Data loaded every day in the dashboard

on opening the dashboard, restrict the data to latest 3-5 days, if the the user wants to see all 15 days data then he will use the clear option.

Community Browser