We have a busy source table and have lots of transaction every minutes. However we don't see the table gets replicated under CDC into target. Source is MySQL 8.0.45 on premise while target endpoint is Snowflake AWS.
We have enabled target apply to verbose however it's not showing up as target apply in the logfiles. It only has source_capture.
I'm not sure whether the table's change events were actually recorded in the BINLOG. However, it's difficult to determine the root cause from only a small portion of the task log.
I'd suggest the following steps:
Add the internal parameters keepCSVFiles and keepErrorFiles, and set both to TRUE.
Set source_capture/target_apply to Verbose logging.
Keep the task running for another 5–10 minutes. Then decrypt the Verbose logs and review them to identify the root cause.
Check the interim CSV files generated by the setting in Step 1 to see whether any change records are present.
This should help us determine whether the change events were captured from the BINLOG and, if so, where the processing is stopping.
Hope this helps.
John.
Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
You nailed it. The binlog is not captured at the source. What happened was the source DB did not include the database that we want to replicate or recorded into binlogs. So Qlik replicate is unable to find them.
Once I have added "binlog-do-db = DBname" in /etc/my.cnf. Bravo! It works again!
