topic Re: Capture rejected record's column in Data Quality

Capture rejected record's column

Anonymous — Sat, 16 Nov 2024 09:43:24 GMT

Hi,

So I know how to capture rejected records of a file, like by using Row>Rejected. This does filter the rejected records,tells us which value is causing the issue and also which line. But it does not tells us which column does that value falls in.

I need to know which column's value has been rejected. Any help is appreciated. Thanks in advance.

Re: Capture rejected record's column

Anonymous — Wed, 31 May 2017 09:18:23 GMT

Hi
It does't not contain the information which column has the error, take a look at tschemaCompilanceCheck component, use a custom schema to check the data, the error message thrown by this component point out which column has the error.

Regards
Shong

Re: Capture rejected record's column

Anonymous — Tue, 13 Jun 2017 11:47:15 GMT

Thanks for the reply.

Talend makes the faulty value as null. Is there any way we can change that value, or enter any other value if the value is rejected?

Re: Capture rejected record's column

Anonymous — Wed, 14 Jun 2017 04:33:00 GMT

Hi
Read all columns as string type, link the input component to tSchemaComplianceCheck and use a custom schema to check it,

tFileInputDelimited--main--tSchemaComplianceCheck --main-->tlogrow

--reject-->tlogrow

the reject flow contains all the information, the output looks like:
.--+----------+---------+-------------.
| tLogRow_1 |
|=-+----------+---------+------------=|
|id|newColumn1|errorCode|errorMessage |
|=-+----------+---------+------------=|
|a |elise |2 |id:wrong type|
'--+----------+---------+-------------'

Regards

Shong

Re: Capture rejected record's column

Anonymous — Wed, 14 Jun 2017 06:09:19 GMT

Thanks a lot Shong!

This is working. Actually I yried this component before, but I couldn't use it properly it seems. Wish I would got a solution to this earlier when I posted this, It would have saved a lot of time.

But thanks anyway.