Can QTC run data quality checks on the data while the pipeline is running?
Hi,
Previously we built a pipeline in Talend Studio that runs data rule checks on the data as it passes through the pipeline. For example, we set a data quality rule where all rows in a certain column must be capitalised.
Then, the rows that failed are sent to talend data stewardship for amendment.
Is there any way to do that with within the Qlik side of things only, without using any Talend software? We're aiming to keep everything in the Qlik Cloud console for simplicity.
Currently, I see that you can use Automations in Qlik Cloud alongside the Qlik Cloud Catalog connector, however, the functionality in this is not exactly what we are aiming for. Is there anything more robust, or is there any data quality checks we can implement in an actual data integration project? Something like the tDQRules component?