topic Re: Data Missed in Replication in Qlik Replicate

Data Missed in Replication

anirudhsharma3 — Fri, 22 Mar 2024 13:09:52 GMT

Hi team ,

We are getting below error while replicating incremental data from Source (Oracle 19C ) to Target S3.

00005456: 2024-02-29T13:01:20 [TARGET_APPLY ]E: Failed to convert file from csv to parquet [1024902] (file_utils.c:899)
00005456: 2024-02-29T13:01:20 [TARGET_APPLY ]E: Failed to convert file 'D:\data\tasks\Qlik_Ingenium_Ingst\data_files\KCAPUAT3.TCVG__Incr\20240229-073120718.tmpcsv'. [1024902] (file_imp.c:2546)
00006700: 2024-02-29T13:01:20 [TASK_MANAGER ]W: Table 'KCAPUAT3'.'TCVG' (subtask 0 thread 1) is suspended. Failed with a table error. (replicationtask.c:3150)
00005456: 2024-02-29T13:01:20 [TARGET_APPLY ]E: Failed to convert file from csv to parquet [1024902] (file_utils.c:899)

Attaching csv file also for your refrence . Kindly let us know the root cause of this error .

Regards

Anirudh

Re: Data Missed in Replication

Heinvandenheuvel — Fri, 22 Mar 2024 18:02:25 GMT

This feels like it should be a support ticket, more so than a community help request.

Providing the CSV is critical, but I hope you screened it for sensitive data.

If (when!) you submit your support ticket please provide some background info

Did it ever work?
Specific to specifc table having changes?
Significant changes (software / driver patch ersions)
Volume dependent?
Can you reproduce at wil? If so, please explain in detail.

Hein.

Re: Data Missed in Replication

john_wang — Fri, 22 Mar 2024 15:06:25 GMT

Hello @anirudhsharma3 ,

Besides @Heinvandenheuvel comments, looks like invalid UTF-8 data cause the error. Please set the Maximum file size(KB): to smaller even to 1 so far it's easier to figure out the invalid chars.

Thanks,

john.