Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
sijojoseph22
Creator II
Creator II

Data Check Tool

Hi All,

Is there any tool available in to do the data check,like

1) Finding the special character in files

2) Finding the difference in the column names while comparing the multiple files

3) Find the records with different format

4) Text appearing the number format.

....

Please advise

Thanks,

Sijo

2 Replies
petter
Partner - Champion III
Partner - Champion III

All of the things you list can be done with Qlik Sense although it is not in a single "tool"-like feature. You do have to do some load script coding to achive for instance 1 and 2. 3 and 4 can be done directly: Mixed data type field will indicate that it is mixed by not having the tags for $numeric, $date or any of the specific data type tags. Can be seen in the Data Model Viewer. Here you can also have statistics for how many distinct values and null values that could be very valuable.


If you're comfortable with Python or R they can be employed with libraries to support data quality inspection and data cleaning before you bring them into Qlik or during the load script process by using Qlik SSE:

A couple of almost random links to what is out there:

https://cran.r-project.org/doc/contrib/de_Jonge+van_der_Loo-Introduction_to_data_cleaning_with_R.pdf

https://pypi.org/project/datagristle/

Data quality diagnosis

sijojoseph22
Creator II
Creator II
Author

thanks