Qlik Community

Qlik Sense Data Connectivity

Discussion board where members can learn more about Qlik Sense Data Connectivity.

Not applicable

QlikView and QlikSense with Spark

Hi,

We want to integrate one of products with Spark in our software solution, but we have some question below.

  1. Do QlikView and Qlik Sense both support Apache Spark and SparkSQL ? and both via JDBC/ODBC data integration ?
  2. Based on these products with spark, is there any file size/dimension/structure limitation?
  3. Is it possible to process data and visualize it in five minutes?

In our solution

  1. It generates 30G data size, including 10 csv files, per day.
  2. There are millions of piece of data in each csv file.
  3. It has about 3-6 dimension in our data (e.g. the population in each country, region, province, district, etc)
  4. Providing data every 5 minute and processing/visualizing, including bar/pie/..char, it to front-end.
  5. User will define their own specific chart, such as multi-dimension column chart, from our data.

    

Can anyone give us some suggestion or thinking for these issues?


Thanks / Michael


1 Reply
doplear01
New Contributor III

Re: QlikView and QlikSense with Spark

Do you solve this issue? we have the same problem here

Community Browser