Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

5 million Data loaded every day in the dashboard

Hi,

The requirement of our dashboard is to show the data in detail and summary tabs.

The count of data per day is approx. 5 Millions and in the dashboard we are showing the 15 days data.

So , the problem is , we are pulling in all the 5 Millions * 15 Days data in the details tab , due to which the performance of the dashboard is degrading and there is always a lag when we select any filters or move across the tabs.

Can you please provide some solution to tackle this problem ? As how we can optimize the performance.

Thanks

10 Replies
ThornOfCrowns
Specialist II
Specialist II

Save the data out to QVD(s) as a first step.

ashfaq_haseeb
Champion III
Champion III

Hi,

How many fields you have?

are you use complex calculation?

Is your machine hosted on VM?, If yes you need physical machine.

How much ram and CPU you have?

Regards

ASHFAQ

Not applicable
Author

Hi,

If you can't aggregate the data you should add calculation condicionals like selecting one day or something that filter your data in order to limit the number of rows. you can also add buttons also with tipical user filters.

I don't think the users need all the data at the same time.

Cheers,

David

mikkeltaylor
Creator II
Creator II

I would also consider building a more aggreagted Dashboard file for fast performance and then have a separate Dashboard with the detailed data.   Use document chaining when the user needs to move from aggregated to detailed data.

Michael.

Anonymous
Not applicable
Author

QVD is already setup.Thanks

Anonymous
Not applicable
Author

There is no complex calculation involved , its the Raw data which is being dumped into the dashboard.

Anonymous
Not applicable
Author

The data is filtered based on the dates. But the problem is each business day as 5 Million volume data.

Anonymous
Not applicable
Author

Can you please guide me in implementing the Document Chaining?

PradeepReddy
Specialist II
Specialist II

on opening the dashboard, restrict the data to latest 3-5 days, if the the user wants to see all 15 days data then he will use the clear option.