How to Handling the transactional data and create the dash board

[sanal_ELM]

Hi All,

Here is my requirement, Could you please help me to find out a solution.

I need to create a  dashboard, which taking  the data from different sources. But here is the challenge, it is taking billions of data from different  sources( transnational table , per day 8-9 millions of rows; year 2012 on wards).

Please guide me how to handle billions of data and to create the dash board.

Regards,

SE

[miskinmaz]

You need to apply the incremental load logic.

You can use below link to start with

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

[sanal_ELM]

Incremental load is generic method to handle the data load time and compression.I am looking for any other method to handle the whole data without rendering the dashboard.

[chriscammers]

Although I agree Incremental loading is a likely part of whatever your solution ends up looking like I think you are expecting a lot without providing very much detail.

Granted, if you have enough computing power behind it, you load billions of rows of data into Qlik and just start creating dashboards, but I doubt you have a server large enough to use that approach.

So many organizations skip the important work of gathering requirements and designing the data to be included in the Application. Once you have a plan then you can talk seriously about different strategies to get the data into your users hands.

[sanal_ELM]

I am looking for some generic methods to follows in this scenario.Still the requirement is not finalized.