Performance Degradation while fetching data from MongoDB Following Qlik Sense Upgrade

fabdulazeez — Mon, 15 Apr 2024 06:56:18 GMT

We upgraded our Qlik Sense environment from November 2022 to February 2024, which also included an upgrade to the Simba driver as part of the Qlik ODBC package for MongoDB, as per guidance from Qlik support. However, we're experiencing a significant degradation in performance for certain queries involving large datasets.
Comparing logs between the old and new versions, it's evident that a query that previously took only a few seconds is now taking over four minutes to execute.

November 2022
20240415T000217.681+0400 9 fields found: FLT_FLIGHT_NO, flightInfo_loads_dim1_idx, groupName, DESTINATION_TYPE, LOADDATA_TYPE, PART_NUMBER, destinationAirport, sourceAirport, SOURCE,
20240415T000222.659+0400 174,864 lines fetched
20240415T000222.663+0400 0373 Inner Join (LOAD_OPS_TAB)

February 2024
20240415T083859.515+0400 9 fields found: FLT_FLIGHT_NO, flightInfo_loads_dim1_idx, groupName, DESTINATION_TYPE, LOADDATA_TYPE, PART_NUMBER, destinationAirport, sourceAirport, SOURCE,
20240415T083911.149+0400 179,143 lines fetched
20240415T084328.897+0400 0377 Inner Join (LOAD_OPS_TAB)

This problem continues to affect numerous similar queries in the script, resulting in significantly extended completion times.

Notably, analysis of the logs indicates that the time taken to fetch records from the database remains consistent with pre-upgrade levels. The significant increase in time occurs after the records have been retrieved.For instance, the records were fetched at 20240415T083911, just a few seconds after the query execution. However, the subsequent log entry appears at 20240415T084328, indicating a delay of four minutes.

Has anyone encountered a similar issue? Please let me know if anyone has suggestions on how I can proceed.

Re: Performance Degradation while fetching data from MongoDB Following Qlik Sense Upgrade

fabdulazeez — Mon, 28 Oct 2024 06:55:28 GMT

Issue was below which was fixed in February 2024 Patch 6

QB-26558

Qlik Engine: Connector performance reload issues in Qlik Sense February 2024

The Select Statement Lineage for Sense Server has been disabled as it served no purpose in Qlik Sense Enterprise on Windows. This was causing issues with some connectors by making irrelevant calls in Sense Server.

topic Re: Performance Degradation while fetching data from MongoDB Following Qlik Sense Upgrade in Connectivity & Data Prep

Performance Degradation while fetching data from MongoDB Following Qlik Sense Upgrade

Re: Performance Degradation while fetching data from MongoDB Following Qlik Sense Upgrade