Skip to main content

Qlik Replicate - Right Truncation of data when replicating from or to PostgreSQL

No ratings
cancel
Showing results for 
Search instead for 
Did you mean: 
dima_etkin
Support
Support

Qlik Replicate - Right Truncation of data when replicating from or to PostgreSQL

Last Update:

Jul 20, 2022 6:21:31 PM

Updated By:

dima_etkin

Created date:

Jul 20, 2022 6:16:01 PM

This article describes a situation involving a PostgreSQL source or target (any supported flavour) when during the replication a message similar to  the below can be received from the task:

String data, right truncation Line xxx  

 

Environment

  • Qlik Replicate 
  • Postgres Source + Target with predetermined datatype length (Relational or similar)
  • Any supported source + Postgres Target

 

Resolution

Add "additionalConnectionProperties" internal parameter with "LFConversion=0" value to Postgres Endpoint. ODBC connection string parameters for PostgreSQL database are documented here 

 

Cause 

There is Postgres ODBC Driver feature that automatically translates "\n" (LF, 0x0a, New Line) in the data stored in this DB to "\n\r" (LF/CR, 0x0a0d, New Line+Carriage Return) upon data retrieval using the ODBC driver. Usually this is unnoticeable, until it causes cos it may increment the length of the source string beyond the designated length of the same column on the target causing symptoms similar to right truncation...

 

Related Content 

https://www.enterprisedb.com/docs/odbc_connector/latest/05_edb-odbc_connection_properties/

 

Internal Investigation ID(s) 

Case 00043675

Contributors
Version history
Last update:
‎2022-07-20 06:21 PM
Updated by: