We upgraded our Qlik Sense environment from November 2022 to February 2024, which also included an upgrade to the Simba driver as part of the Qlik ODBC package for MongoDB, as per guidance from Qlik support. However, we're experiencing a significant degradation in performance for certain queries involving large datasets.
Comparing logs between the old and new versions, it's evident that a query that previously took only a few seconds is now taking over four minutes to execute.
November 2022
20240415T000217.681+0400 9 fields found: FLT_FLIGHT_NO, flightInfo_loads_dim1_idx, groupName, DESTINATION_TYPE, LOADDATA_TYPE, PART_NUMBER, destinationAirport, sourceAirport, SOURCE,
20240415T000222.659+0400 174,864 lines fetched
20240415T000222.663+0400 0373 Inner Join (LOAD_OPS_TAB)
February 2024
20240415T083859.515+0400 9 fields found: FLT_FLIGHT_NO, flightInfo_loads_dim1_idx, groupName, DESTINATION_TYPE, LOADDATA_TYPE, PART_NUMBER, destinationAirport, sourceAirport, SOURCE,
20240415T083911.149+0400 179,143 lines fetched
20240415T084328.897+0400 0377 Inner Join (LOAD_OPS_TAB)
This problem continues to affect numerous similar queries in the script, resulting in significantly extended completion times.
Notably, analysis of the logs indicates that the time taken to fetch records from the database remains consistent with pre-upgrade levels. The significant increase in time occurs after the records have been retrieved.For instance, the records were fetched at 20240415T083911, just a few seconds after the query execution. However, the subsequent log entry appears at 20240415T084328, indicating a delay of four minutes.
Has anyone encountered a similar issue? Please let me know if anyone has suggestions on how I can proceed.
