Skip to main content

Out of Memory Error when Importing/Exporting Metadata in Qlik Catalog

No ratings
cancel
Showing results for 
Search instead for 
Did you mean: 
Gerald_U
Support
Support

Out of Memory Error when Importing/Exporting Metadata in Qlik Catalog

Last Update:

Jul 4, 2023 9:22:14 AM

Updated By:

Sonja_Bauernfeind

Created date:

Jul 4, 2023 9:22:14 AM

Importing or Exporting Metadata in Qlik Catalog leads to an Out of Memory error (img 1).

out of memory.png

 

Resolution

This is caused by the /metadataImport/viewLogs listing, which truncates the status log message to 500 characters.

The August 2023 release contains a code fix for this behavior. The full status log will still be returned when "View Details" is invoked for an individual record. The August 2023 release will also speed up the database retrieval for this table.

Workaround until August 2023 is available:

As a short-term workaround, database records can be truncated to avoid returning too much data to the browser. To achieve this, we need to truncate the status log column for all import/export records to the last 500 characters:

update podium_core.pd_data_migration_workorder set status_log=right(status_log,500);

You can run this command using PgAdmin for Postgres:

 

Cause

The issue is caused by extremely large "Information Message" status associated with each record. This is column "status_log" in podium_md database table "pd_data_migration_workorder". We was able to reproduce the issue by writing 4MB status_log to each row and then reloading that page. The most recent 100 status are loaded. The API call that is executed is:

/qdc/metadataImport/viewLogs/?count=100&start=0&sortAttr=loadTime&sortDir=DESC

The full status log is returned with each of the 100 records.

 

Environment

Qlik Catalog 

Labels (1)
Version history
Last update:
‎2023-07-04 09:22 AM
Updated by: