Re: Failed to write the files to S3 target - Qlik Community

haiderpasha · ‎2024-05-24

Hello Team

We are trying replicate the data to S3 and the full load has been completed but the Changed records are not getting written to S3. It is throwing below errors; Could you help us with the root cause of these errors?

00003332: 2024-05-24T11:17:32 [TARGET_APPLY ]E: Failed to rename file from 'C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp' to 'C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111730883.csv'. [1000121] (file_utils.c:491)

00003332: 2024-05-24T11:17:32 [TARGET_APPLY ]E: Failed to rename file 'C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp'. [1000121] (file_imp.c:2545)

00003332: 2024-05-24T11:17:32 [TARGET_APPLY ]E: Failed to handle an unfinished file processing. [1000121] (file_apply.c:792)

00003332: 2024-05-24T11:17:32 [TARGET_APPLY ]I: Error executing command [1000121] (streamcomponent.c:2055)

00003332: 2024-05-24T11:17:32 [TASK_MANAGER ]I: Stream component failed at subtask 0, component st_0_TEST_S3_1 [1000121] (subtask.c:1465)

00003332: 2024-05-24T11:17:32 [TARGET_APPLY ]I: Target component st_0_TEST_S3_1 was detached because of recoverable error. Will try to reattach (subtask.c:1580)

00003332: 2024-05-24T11:17:37 [STREAM_COMPONEN ]I: Target last committed record id from the previous run is '65' (streamcomponent.c:1692)

00003332: 2024-05-24T11:17:37 [TARGET_APPLY ]I: Target endpoint 'Amazon S3' is using provider syntax 'AmazonS3Syntax' (provider_syntax_manager.c:979)

00003332: 2024-05-24T11:17:37 [TARGET_APPLY ]I: Working in transactional apply mode (endpointshell.c:2098)

00003332: 2024-05-24T11:17:37 [SOURCE_CAPTURE ]I: Source endpoint 'AWS Aurora Cloud for PostgreSQL' is using provider syntax 'PostgreSQL' (provider_syntax_manager.c:973)

00003332: 2024-05-24T11:17:37 [SOURCE_CAPTURE ]I: Going to connect to ODBC connection string: Driver={PostgreSQL Unicode(x64)};Server=awsu1-1mltxd01q-instance-1.c8hfrla4lcia.us-east-1.rds.amazonaws.com;Port=5432;Database=ods;UseDeclareFetch=1;Fetch=10000;Uid=ods_dms_user;pqopt={sslcompression='1' }; (postgres_endpoint_util.c:263)

00003332: 2024-05-24T11:17:37 [SOURCE_CAPTURE ]I: ODBC driver version: '13.00.0000' (ar_odbc_conn.c:633)

00003332: 2024-05-24T11:17:37 [SOURCE_CAPTURE ]I: Going to connect to ODBC connection string: Driver={PostgreSQL Unicode(x64)};Server=awsu1-1mltxd01q-instance-1.c8hfrla4lcia.us-east-1.rds.amazonaws.com;Port=5432;Database=ods;UseDeclareFetch=1;Fetch=10000;Uid=ods_dms_user;pqopt={sslcompression='1' }; (postgres_endpoint_util.c:263)

00003332: 2024-05-24T11:17:37 [SOURCE_CAPTURE ]I: ODBC driver version: '13.00.0000' (ar_odbc_conn.c:633)

00003332: 2024-05-24T11:17:37 [SOURCE_CAPTURE ]I: Source database version number is: 150004 (postgres_endpoint_util.c:653)

00003332: 2024-05-24T11:17:37 [SOURCE_UNLOAD ]I: PostgreSQL database server encoding is 'UTF8' (postgres_endpoint_imp.c:922)

00003332: 2024-05-24T11:17:37 [TARGET_APPLY ]I: Target components st_0_TEST_S3_1 was reattached after 5 seconds. (subtask.c:1449)

00003332: 2024-05-24T11:17:37 [TARGET_APPLY ]I: Attempting to resume file post-processing after an error. (file_apply.c:769)

00003332: 2024-05-24T11:17:37 [IO ]E: The system cannot find the file specified. (apr status = 720002) [1000121] (at_file.c:447)

00003332: 2024-05-24T11:17:37 [IO ]E: Failed to rename file <C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp> to <C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111737918.csv> [1000121] (at_file.c:456)

00003332: 2024-05-24T11:17:37 [IO ]E: Failed to rename file from <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp> to <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111737918.csv>: The system cannot find the file specified. [1000121] (at_file.c:3036)

00003332: 2024-05-24T11:17:37 [IO ]E: Failed to copy file from <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp> to <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111737918.csv>: The system cannot find the file specified. [1000121] (at_file.c:2945)

00003332: 2024-05-24T11:17:38 [IO ]E: The system cannot find the file specified. (apr status = 720002) [1000121] (at_file.c:447)

00003332: 2024-05-24T11:17:38 [IO ]E: Failed to rename file <C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp> to <C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111737918.csv> [1000121] (at_file.c:456)

00003332: 2024-05-24T11:17:38 [IO ]E: Failed to rename file from <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp> to <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111737918.csv>: The system cannot find the file specified. [1000121] (at_file.c:3036)

00003332: 2024-05-24T11:17:38 [IO ]E: Failed to copy file from <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\CDC00000000.tmp> to <\\?\C:\Program Files\Attunity\Replicate\data\tasks\ODS_ProdCopy_S3_RGA Table\data_files\public.sales_order__ct\20240524-111737918.csv>: The system cannot find the file specified. [1000121] (at_file.c:2945)