topic Printing defined Schema from tChemaComplianceCheck (or any other component) to a tLog / tMap / tWarn in Talend Studio

Printing defined Schema from tChemaComplianceCheck (or any other component) to a tLog / tMap / tWarn

dani_fm — Sat, 16 Nov 2024 00:35:01 GMT

Hi,

I'm trying to handle some errors in my job. I use the tSchemaComplianceCheck to validate data and send a tWarn to our organization and to the customer to validate the data of the input file. I can identify the column and the type of error but I would also like to attach the actual schema that the process is expecting, that is the one defined in the tSchemaComplianceCheck. If there is no way I could also copy and define the schema in another component and print it with some conditions, the problem is that I couldn't find the way to print the expected schema (column, type, pattern,nullable,...) in any form.

How can I manage it?

Thanks in advance

Re: Printing defined Schema from tChemaComplianceCheck (or any other component) to a tLog / tMap / tWarn

Anonymous — Thu, 18 Feb 2021 08:11:23 GMT

Hi dani_fm

The schema of tSchemaComplianceCheck is used to validate the data and the component output the valid data /invalid data, no a way to print the schema on other component. The schema of rejected data is pre-defined and you can customize the warn message with the error message, see below screenshot.

Regards

Shong

Re: Printing defined Schema from tChemaComplianceCheck (or any other component) to a tLog / tMap / tWarn

dani_fm — Thu, 18 Feb 2021 11:15:15 GMT

Hi shong,

Thank you for your answer. Yes, I'm returning the errorMessage in the tWarn but I would also like to put the information that the process is expecting.

tWarn returns-> COL3:wrong type

Then I would also print in the console something like:

COL1 | String | Not null | .....

COL2 | String | ....

COL3 | Integer | ....

So we will know that in COL3 we are expecting an Integer and we have to change the data.

It does not matter if it's using the tSchemaComplianceCheck and a tWarn. It could be any other component where you define a schema but I would like to print it.

Re: Printing defined Schema from tChemaComplianceCheck (or any other component) to a tLog / tMap / tWarn

Anonymous — Fri, 19 Feb 2021 03:29:53 GMT

I see, but the component does not provide the functionality of printing the schema information on the console, and no component has such a function.