Hi,
We want to integrate one of products with Spark in our software solution, but we have some question below.
- Do QlikView and Qlik Sense both support Apache Spark and SparkSQL ? and both via JDBC/ODBC data integration ?
- Based on these products with spark, is there any file size/dimension/structure limitation?
- Is it possible to process data and visualize it in five minutes?
In our solution
- It generates 30G data size, including 10 csv files, per day.
- There are millions of piece of data in each csv file.
- It has about 3-6 dimension in our data (e.g. the population in each country, region, province, district, etc)
- Providing data every 5 minute and processing/visualizing, including bar/pie/..char, it to front-end.
- User will define their own specific chart, such as multi-dimension column chart, from our data.
Can anyone give us some suggestion or thinking for these issues?
Thanks / Michael
