Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Streamlining user types in Qlik Cloud capacity-based subscriptions: Read the Details
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

data cleaning checks

Hi Experts,

 

How to apply given below data validation rules in talend. which components we can use with example. thanks

 

Max_length_if_not_empty
Null_blank_check
Invalid_pattern_check_if_not_empty
Is_empty
Date_Comparision
Datetime_format_check_if_not_empty
Valid_values_if_not_empty (in from of reference data/lookup)
Valid_values_if

Labels (2)
4 Replies
fdenis
Master
Master

The anser is you can do it with talend.

But: How why where?
as a consultant questions are:
how many times do you want to check that!
is it for migration or for run
are rules fix or they are going to change?
do you want to add rules?
what is the language of rules?
where are the data in db, file, cloud?
why do you want talend to do that!
and some others….

Morpheus
Contributor III
Contributor III

Hi @abhityagi,

Are you trying to do something like a regular data health check to increase the quality of your daily/weekly feeds or you are trying to just check the overall data health as a pre-check before a migration?

Anonymous
Not applicable
Author

Thanks for your reply. I am looking for overall data health as a pre-check before a migration.

 

Thanks,

Abhishek

fdenis
Master
Master

you are looking for Rule-based system like drools-