Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
Is there any tool available in to do the data check,like
1) Finding the special character in files
2) Finding the difference in the column names while comparing the multiple files
3) Find the records with different format
4) Text appearing the number format.
....
Please advise
Thanks,
Sijo
All of the things you list can be done with Qlik Sense although it is not in a single "tool"-like feature. You do have to do some load script coding to achive for instance 1 and 2. 3 and 4 can be done directly: Mixed data type field will indicate that it is mixed by not having the tags for $numeric, $date or any of the specific data type tags. Can be seen in the Data Model Viewer. Here you can also have statistics for how many distinct values and null values that could be very valuable.
If you're comfortable with Python or R they can be employed with libraries to support data quality inspection and data cleaning before you bring them into Qlik or during the load script process by using Qlik SSE:
A couple of almost random links to what is out there:
https://cran.r-project.org/doc/contrib/de_Jonge+van_der_Loo-Introduction_to_data_cleaning_with_R.pdf
thanks