topic Re: Snowflake target in Qlik Replicate

Snowflake target

suvbin — Tue, 13 Feb 2024 04:49:27 GMT

Hi ,

00032512: 2024-02-12T21:16:30 [TARGET_LOAD ]E: RetCode: SQL_ERROR SqlState: 22000 NativeError: 100144 Message: Invalid UTF8 detected in string 'ï¿½ï¿½'

File '1/LOAD00000044.csv.gz', line 4063416, character 130

Row 4063342, column "CDPOS"["VALUE_NEW":17]

If you would like to continue loading when an error is encountered, use other values such as 'SKIP_FILE' or 'CONTINUE' for the ON_ERROR option. For more information on loading options, please run 'info loading_data' in a SQL client. [1022502] (ar_odbc_stmt.c:5003)

Request your help on this.

Re: Snowflake target

aarun_arasu — Tue, 13 Feb 2024 05:04:31 GMT

Hello @suvbin ,

Thanks for reaching out to Qlik community.

Can you please try the below settings and let us know if that helps

task settings->character substitution->character set->UTF-8 to U+0.

Reload the table

Regards,

Arun

Re: Snowflake target

SachinB — Tue, 13 Feb 2024 05:06:24 GMT

Hello @suvbin ,

Thank you for reaching out to the Qlik community!

Solution:
1)Task settings->character substitution->character set->UTF-8 to U+0
2) Reload the task again

Please try it and let us know for the same.

Regards,

Sachin B

Re: Snowflake target

john_wang — Tue, 13 Feb 2024 08:48:38 GMT

Hello @suvbin ,

If you like to figure out the root reason of the invalid UTF8 chars, we may try below steps to get the reason:

Open Snowflake target endpoint
Go to the Advanced tab
Open Internal Parameters
Add new parameters named keepCSVFiles & keepErrorFiles
Set their values to TRUE

Recreate the error, then check the generated CSV files on Replicate Server task sub-folder to get further understanding of the error. Maybe it's code page incorrect setting, or some special chars which is not a UTF8 char, or something else. Comparison the chars with source side Database data may get clues.

Hope this helps.

John.

Re: Snowflake target

suvbin — Wed, 14 Feb 2024 03:27:41 GMT

Enabled character substitution for utf-8 . Again getting the same error .

Re: Snowflake target

john_wang — Thu, 15 Feb 2024 02:12:58 GMT

Hello @suvbin ,

If we can figure out the root cause then it's easier to tell a workaround or solution. Any clue from the interim CSV files?

thanks,

John.