Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I am using replicate and using a source of aurora Postgres and target of Kafka topic. For all update messages I see the data section and beforeData section. All documentation shows the beforeData should be all the previous data values before the update. In my case this is not true. I see tue same values except for the PK. The before data is null and new data has a value. All other fields are the same values. This is true for any update even if the other data elements are changing. The PK is not being changed at all.
Does anyone know why this is happening?
Hi,
I just checked the user guide for Aurora Postgres source and one of the limitations is that Before Image is not supported, that is why you are seeing Nulls.
Thanks
Michael
Ok thank you. I was not sure if that limitations referred to this ability. Since I am trying to see what changed and send that info to Kafka, are there any work arounds that may work? If I select only the columns I want from the source table vs all the columns, will the UPDATE message only come into Kafka if any of those columns changed? Or will will send the UPDATE message if any column changed, even if I did not select it in the replicate task?
Looking for any recommendations to achieve this.
Thanks
Jeff
Hi Jeff,
Only the columns that are included in Replicate and that were changed will be included.
Thanks
Lyka