Qlik Replicate and PostgreSQL source: task fails with data truncation

[Michael_Litz]

After an upgrade of Qlik Replicate (2022.5 to 2023.11), tasks using a PostgreSQL source see truncations for the varchar column when running a full load.

The following is logged in the source_unload logging component:

[SOURCE_UNLOAD ]V: Value for (varChar column)  was truncated. bind type: -8, data len: 14 (14, after truncation: -2), bind len: 0, statement:

 

Environment

• Qlik Replicate 2023.11 and later
• PostgreSQL

Resolution

Add the Internal Parameter unboundedVarcharMaxSize on the Postgres Aurora source endpoint and set it to 8000.

If you are using Logstream setup, please add unboundedVarcharMaxSize on the Postgres Aurora source endpoint in both the Logstream Parent task and child task.

To resolve the issue:

1. Go to the  Endpoint connection
    
2. Switch to the Advanced tab
    
3. Click Internal Parameters
    
4. Add the Parameter: unboundedVarcharMaxSize
   
   If the parameter already exists, modify the value as per step 5. 
    
5. Add value: 8000
   
   
   
   For more information about Internal Parameters, see Qlik Replicate: How to set Internal Parameters and what are they for?
    
   

Cause

The Internal Parameter has unexpectedly changed between Qlik Replicate 2022.5 and 2023.11. This only affected Postgres Aurora.

While unboundedVarcharMaxSize had a default value of 8000 in 2022.5, it is now set to -1 for Postgres Aurora by default.

Internal Investigation ID(s)

RECOB-8644