2 Replies Latest reply: Nov 28, 2017 10:06 AM by Quy Nguyen RSS

    Simba Spark ODBC error

    Quy Nguyen

      Hello,

       

      I am using Simba Spark ODBC to get data from Hadoop Spark.

      I set up the ODBC in system ODBC and use it in Qlik Sense Script.

      When selecting data from a table by query like this:

      SQL SELECT Field1, Field2

      FROM SPARK.`default`.`table` where partition='20171010' limit 1000;

      With limit 1000 it returns the data successfully.

       

      But with limit 1000000 or larger, it returns the error:

      The following error occurred:

      SQL##f - SqlState: S1000, ErrorCode: 35, ErrorMsg: [Simba][Hardy] (35) Error from server: error code: '0' error message: 'ExecuteStatement finished with operation state: ERROR_STATE'.

      I want to get the data daily, and my data has 80M rows each day.

       

      Please help.