Handling data preparation invalid rows

Anonymous — Sat, 16 Nov 2024 05:54:55 GMT

Hi !
I created recepie in data preparation which return only the invalid rows.
The recepie is triggered using tDataprepRun in talend studio on each row in file.
I would like to know why the rows are invalid (writing the reason to file or log).
How can i do that base on talend studio and data preparation? (Ignore data stewardship please)

Re: Handling data preparation invalid rows

Anonymous — Tue, 07 May 2019 09:30:20 GMT

Hi,

The short answer is that a proper "rejected" data management in Data Prep/Studio is part of our roadmap. Per the current plan, it's candidate for the 7.3 release.

This said, today, I suggest you to play around the following scenario: in Data Prep, you can perfectly create a new empty column (such as "reason why?"). When filtering on invalid values in your prep, fill in this column with the corresponding reason using standard mass functions.

Thanks,

Patrick

topic Re: Handling data preparation invalid rows in Data Quality

Handling data preparation invalid rows

Re: Handling data preparation invalid rows