Skip to main content
Announcements
NEW: Seamless Public Data Sharing with Qlik's New Anonymous Access Capability: TELL ME MORE!

How to Implement Data Quality Rules

No ratings
cancel
Showing results for 
Search instead for 
Did you mean: 
mnu
Employee
Employee

How to Implement Data Quality Rules

Last Update:

Apr 16, 2017 11:45:18 PM

Updated By:

mnu

Created date:

Apr 16, 2017 11:45:18 PM

Attachments

It's a fact of life that the Qlik applications we build will have data quality issues. After all, we are humans! The good news is that there is a simple solution using the evaluate function that can help us to build up a list of data quality rules to check against our data.

The first step is build up the rules in a spreadsheet along with a formula that will evaluate to true if the record is in error. Refer to DataQualityRules.xlsx below. I've put two basic examples but any expression that will evaluate against a single row of data should work. For example, you could use len to check for correct string length, or match to check for particular values.

Data Quality Rules 1.PNG

The second step is to the load our sample data set and ensure we have a key field that uniquely identifies each record in our data. In the example the field is called RowNo but can be any unique key field in the data.

The last step is to evaluate each record of our data set against the data quality rule using a for loop. The result is a table that can be used on a Data Quality tab, for example, to highlight problems with the data. Click on each rule will allow you to see which records broke each rule.

Data Quality Rules 2.PNG

Note: This solution will work for both QlikView and Qlik Sense.

Matt Nunn

Qlik Consulting

Comments
Lee_Matthews
Former Employee
Former Employee

Nice work!

0 Likes
kjl
Employee
Employee

Very good example!

0 Likes
SabrinaMer
Contributor
Contributor

Hi, 

Thank's for your exemple.

I have a question about this data quality part, in fact I would like to display in the filter pane all the fields of the application in order to have the dynamic tables; for example I can choose the Name field from the filter pane instead of email;

Thank's

0 Likes
Version history
Last update:
‎2017-04-16 11:45 PM
Updated by:
Employee