Data quality checks for replication in Databricks

[maiyaa]

Is there any tooling for validating data that has been mirrored from source tables to Databricks? I’m using AWS DMS for CDC but running into lots of issues with updates being reflected incorrectly in Databricks. Running checks across thousands of tables is needed.

[Michael_Litz]

Hi Maiyaa,

Replicate does not have any data validation routines built in.

Thanks,
Michael

PREVIEW

[SwathiPulagam · Accepted solution]

Hi @maiyaa ,

You can try Querysurge.

It is not a free tool but it is a low-cost validation tool.

Thanks,

Swathi