Qlik Community

QlikView App Development

Discussion Board for collaboration related to QlikView App Development.

Announcements
Talk to Experts Tuesday, Live Q&A, September 22: Moving from QlikView to Qlik Sense. REGISTER
cancel
Showing results for 
Search instead for 
Did you mean: 
Highlighted
Partner
Partner

How to Handling the transactional data and create the dash board

Hi All,

Here is my requirement, Could you please help me to find out a solution.

I need to create a  dashboard, which taking  the data from different sources. But here is the challenge, it is taking billions of data from different  sources( transnational table , per day 8-9 millions of rows; year 2012 on wards).

Please guide me how to handle billions of data and to create the dash board.

Regards,

SE

4 Replies
Highlighted
Creator III
Creator III

You need to apply the incremental load logic.

You can use below link to start with

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

Highlighted
Partner
Partner

Incremental load is generic method to handle the data load time and compression.I am looking for any other method to handle the whole data without rendering the dashboard.

 

Highlighted
Partner
Partner

Although I agree Incremental loading is a likely part of whatever your solution ends up looking like I think you are expecting a lot without providing very much detail.

Granted, if you have enough computing power behind it, you load billions of rows of data into Qlik and just start creating dashboards, but I doubt you have a server large enough to use that approach.

So many organizations skip the important work of gathering requirements and designing the data to be included in the Application. Once you have a plan then you can talk seriously about different strategies to get the data into your users hands.

 

Highlighted
Partner
Partner

I am looking for some generic methods to follows in this scenario.Still the requirement is not finalized.