Qlik Community

Qlik Product Innovation Blog

Learn about what's new across all of the products in our growing Qlik product portfolio.

Employee
Employee

Introducing the Qlik Associative Big Data Index!

Qlik has a unique advantage in the data space – The Associative DifferenceTM. It is our secret sauce that allows all of your data to be brought together and fully indexed to find all the possible associations in the data, across all your data sources.  We’ve now expanded this capability to handle data sources of immense size.  Introducing the Qlik Associative Big Data Index - it's a full associative experience for the biggest data sources you have. And rather than bringing your data to Qlik, our new product brings Qlik to the data. This is a governed, high-performance associative engine that can be deployed within sources such as Hadoop based data lakes, eliminating the need to transfer and prepare the data elsewhere before it can be analyzed.  It’s a proper incremental index optimized for associative queries from the UI all the way down to the data.  And it’s highly scalable as it can be distributed to work across a cluster, both in a cloud or an on-premise environment.

Think of the Qlik Associative Big Data Index as a governed performance layer that can help define your data strategy.  We believe we're giving you the maximum flexibility by offering multiple deployment options: 

  • A Qlik Associative Big Data Index connector in the Data Load Editor allows users to automatically generate a script to access the index with user defined data filters. 
  • Existing On-Demand App Generation (ODAG) deployments can be enhanced by having the Qlik Associative Big Data Index accelerate the request and delivery of selected data for the detail app.
  • The Qlik Associative Big Data Index can directly query the data lake, bypassing the in-memory Associative Engine to create a live window into the governed performance index -all without needing to move data into memory.


To pique your interest, here’s a short video that provides a brief overview of the Qlik Associative Big Data Index:


As previously announced at Qonnections 2018, Qlik will be offering the first release of the Qlik Associative Big Data Index via a Services-led offering that we call the Early Access Program (EAP).  The EAP includes:

  1. The rights to use the software
  2. Customer Success Early Access Services (which are only delivered by Qlik) to design, implement and support the product within the customers’ environment for six months
  3. The opportunity for customers to help shape the future direction of the Qlik Associative Big Data Index technology as they will be able to directly work with the Qlik Product team.

Interested in being part of the Qlik Associative Big Data Index EAP?  To find out if your environment and immediate needs are a good fit, please contact your local Qlik representative to explore being part of the Qlik Associative Big Data Index Early Access Program!

Tags (3)
11 Comments
sirpod90
New Contributor III

Hello,

if I understand it right, the Big Data Index is just working with Hadoop?

No Support for Oracle DB's and generated QVD's?

Regards

0 Likes
488 Views
pauljohansson
Contributor II

Is the "Qlik Associative Big Data Index" going to be part of the product or will it continued to be a separate component?


br

Paul

0 Likes
488 Views
Employee
Employee

Hi

QABDI will be a separate component and require a separate installation which will act as a source for Qlik Sense, within Qlik Sense we will deliver a connector for this purpose

Thanks

Ian

0 Likes
488 Views
Employee
Employee

Hi

The datasource support for the initial phase is non-nested parquet files stored on HDFS/S3/EFS, future sources are planned in the roadmap

Thanks

Ian

0 Likes
488 Views
sirpod90
New Contributor III

Hello Ian,

thanks for the response.

So Qlik is also seeing the need to apply the big data index to Oracle and/or QVD's as well in future releases?

If so it would be great otherwise it is a low hanging fruit.

Regards

0 Likes
488 Views
Employee
Employee

Hi

Yes we are seeing the requirement to support a number of other sources with QABDI including Oracle, In terms of qvd files and qvd management we are also looking into a number of options on how to deliver a governed layer for these, this is in fact a sweet spot for our latest acquisition - Podium

Thanks

Ian

488 Views
kennyunited
New Contributor

Does the APP that use QABDI with or without ODAG support NPrinting as well ? Thanks !

0 Likes
488 Views
Employee
Employee

Hi

Currently even outside of QABDI automatic ODAG+Nprinting of the generated app is not supported

Thanks

Ian

0 Likes
488 Views
kennyunited
New Contributor

Understand, would there be any roadmap for NPrinting integration ?

  • QADBI + NPrinting
  • ODAG + NPrinting

Thanks a lot.

0 Likes
488 Views
Employee
Employee

Hi

Yes this is a roadmap item

Thanks

0 Likes
488 Views
haty
New Contributor III

will this work with MapR? Version 5?

0 Likes
475 Views