Hello,
I am using Simba Spark ODBC to get data from Hadoop Spark.
I set up the ODBC in system ODBC and use it in Qlik Sense Script.
When selecting data from a table by query like this:
SQL SELECT Field1, Field2
FROM SPARK.`default`.`table` where partition='20171010' limit 1000;
With limit 1000 it returns the data successfully.
But with limit 1000000 or larger, it returns the error:
The following error occurred:
SQL##f - SqlState: S1000, ErrorCode: 35, ErrorMsg: [Simba][Hardy] (35) Error from server: error code: '0' error message: 'ExecuteStatement finished with operation state: ERROR_STATE'.
I want to get the data daily, and my data has 80M rows each day.
Please help.
