topic Loading Data from Hive DataLake in Connectivity & Data Prep https://community.qlik.com/t5/Connectivity-Data-Prep/Loading-Data-from-Hive-DataLake/m-p/1649973#M4689 <P>Hello Everyone,</P><P>I'm currently trying to fetch data from a Hive Datalake to Qlik Sense.&nbsp;</P><P>The current table size for last one month is around 6M rows. We are yet to add the Historical data for the last 2-3 yeyrs to the Data Lake.</P><P>As of now i need to perform a One instance Load to save all the existing data(6M) in a QVD. But, our Environment is not able to handle the Load. It fails with Error Messages like 'java.io.Exception: Error readinf file:' or 'buffer size too small'.</P><P>I've tried to figure out if Qlik Associative Big Data Index would be a probable solution here. But, haven't found concrete Use Cases regarding the same.&nbsp;</P><P>Did anyone already use QABDI or know how to approcah the problem? Any pointers would be highly helpful.</P><P>&nbsp;</P><P>Thanks and Regards</P><P>Sai.</P> Thu, 23 Dec 2021 15:26:46 GMT Sai33 2021-12-23T15:26:46Z Loading Data from Hive DataLake https://community.qlik.com/t5/Connectivity-Data-Prep/Loading-Data-from-Hive-DataLake/m-p/1649973#M4689 <P>Hello Everyone,</P><P>I'm currently trying to fetch data from a Hive Datalake to Qlik Sense.&nbsp;</P><P>The current table size for last one month is around 6M rows. We are yet to add the Historical data for the last 2-3 yeyrs to the Data Lake.</P><P>As of now i need to perform a One instance Load to save all the existing data(6M) in a QVD. But, our Environment is not able to handle the Load. It fails with Error Messages like 'java.io.Exception: Error readinf file:' or 'buffer size too small'.</P><P>I've tried to figure out if Qlik Associative Big Data Index would be a probable solution here. But, haven't found concrete Use Cases regarding the same.&nbsp;</P><P>Did anyone already use QABDI or know how to approcah the problem? Any pointers would be highly helpful.</P><P>&nbsp;</P><P>Thanks and Regards</P><P>Sai.</P> Thu, 23 Dec 2021 15:26:46 GMT https://community.qlik.com/t5/Connectivity-Data-Prep/Loading-Data-from-Hive-DataLake/m-p/1649973#M4689 Sai33 2021-12-23T15:26:46Z