Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Showing results for 
Search instead for 
Did you mean: 
vkolasani
Contributor III
Contributor III

Qlikview Caching and real time data

I’d like to understand how frequent QV can be configured to ingest data into its in-memory data db/engine.  On the flip side, what are QV’s capabilities of forgoing it’s in-memory data engine in favor of accessing data in real-time.  Any drawbacks to this?


Thank you

1 Solution

Accepted Solutions
Peter_Cammaert
Partner - Champion III
Partner - Champion III

QlikView isn't meant to replace the operational dashboards or the direct data access screens of a large centralised application like CRM or ERP or a BigData cloud solution. QlikView is better at consolidating data from different sources and creating a consistent picture that is not necessarily a real-time snapshot. You can shorten the delay between data modification and the following update of dashboards in QlikView by devising a slick strategy to extract just the modifications from a large data set. But since QlikView is never embedded in the central data store or the transactional system, there will always be a data transfer & processing delay to take into account. And I think you can see it coming: the more data to update, the longer the delay.

I know of dashboards that take all of 2 minutes to update and whose reload runs in a closed loop ("continuously"). But I also know of dashboards that take 4 to 6 hours to update and tax the source systems in such a way that administrators prefer to refresh them at night only. Which isn't a problem at all.

There is one technique available that mimics a real-time extraction of source systems, but only for limited data sets (e.g. "get me the details of this transaction amongst a few billion"), not for entire reloads of large documents. It's called Direct Discovery and supports live data connections to data sources of choice. See: Direct Discovery - QlikView

Best,

Peter

View solution in original post

1 Reply
Peter_Cammaert
Partner - Champion III
Partner - Champion III

QlikView isn't meant to replace the operational dashboards or the direct data access screens of a large centralised application like CRM or ERP or a BigData cloud solution. QlikView is better at consolidating data from different sources and creating a consistent picture that is not necessarily a real-time snapshot. You can shorten the delay between data modification and the following update of dashboards in QlikView by devising a slick strategy to extract just the modifications from a large data set. But since QlikView is never embedded in the central data store or the transactional system, there will always be a data transfer & processing delay to take into account. And I think you can see it coming: the more data to update, the longer the delay.

I know of dashboards that take all of 2 minutes to update and whose reload runs in a closed loop ("continuously"). But I also know of dashboards that take 4 to 6 hours to update and tax the source systems in such a way that administrators prefer to refresh them at night only. Which isn't a problem at all.

There is one technique available that mimics a real-time extraction of source systems, but only for limited data sets (e.g. "get me the details of this transaction amongst a few billion"), not for entire reloads of large documents. It's called Direct Discovery and supports live data connections to data sources of choice. See: Direct Discovery - QlikView

Best,

Peter