I'm currently trying to fetch data from a Hive Datalake to Qlik Sense.
The current table size for last one month is around 6M rows. We are yet to add the Historical data for the last 2-3 yeyrs to the Data Lake.
As of now i need to perform a One instance Load to save all the existing data(6M) in a QVD. But, our Environment is not able to handle the Load. It fails with Error Messages like 'java.io.Exception: Error readinf file:' or 'buffer size too small'.
I've tried to figure out if Qlik Associative Big Data Index would be a probable solution here. But, haven't found concrete Use Cases regarding the same.
Did anyone already use QABDI or know how to approcah the problem? Any pointers would be highly helpful.
