topic Re: Using tSchemaComplianceCheck for max length validation of integer/long in Talend Studio

Using tSchemaComplianceCheck for max length validation of integer/long

smunagala1615566132 — Sat, 16 Nov 2024 00:21:31 GMT

Team,

tSchemaComplianceCheck is helping me in validating all the necessary schema validation but

when comes to long datatype, I provided length as 10 but even the value exceeds length of 10 it is not coming under rejects.

Eg:

I have mobile_number column which should hold only 10 digits but schema compliance check is not directing that to rejects. If the number is like 1234567890987 instead writing it into success path.

Could you please suggest me a way to handle this.

Thanks,

Srini

Re: Using tSchemaComplianceCheck for max length validation of integer/long

Anonymous — Mon, 29 Mar 2021 04:36:39 GMT

Hello,

Have you tried to do that by checking in tSchemacompliance in validation rules part? Could you please show us your tSchemacompliance component setting screenshot here?

Best regards

Sabrina

Re: Using tSchemaComplianceCheck for max length validation of integer/long

Anonymous — Mon, 29 Mar 2021 06:31:49 GMT

You need to convert the data type to string before tSchemacompliance if you want to check the length, convert the data type to long back if needed later.

Regards

Shong

Re: Using tSchemaComplianceCheck for max length validation of integer/long

smunagala1615566132 — Mon, 29 Mar 2021 13:38:43 GMT

Thank you Shong,

That's my initial thought but if we do length check first and do the integer check later . I need to unite main and rejects before I pass the data to second tschemacheckcompliance but Talend not letting me to do the tUnite for the same source.

Any suggestions would be greatly helpful. I need the flow like this

Thanks,

Srini

Re: Using tSchemaComplianceCheck for max length validation of integer/long

Anonymous — Tue, 30 Mar 2021 08:33:25 GMT

Talend doesn't allow to create a cycle flow in the job, as a workaround, cache the output data into memory using tHashoutput components, in next subjob, read the data from memory using tHashInput.

...tschemacheckcompliance --main--tHashOutput1

--reject--tHashOutput2

|onsubjobok

tHashInput1---main--tUnite.....

|main

tHashIput2

Regards

Shong

Re: Using tSchemaComplianceCheck for max length validation of integer/long

smunagala1615566132 — Tue, 30 Mar 2021 13:34:30 GMT

Thanks Shong,

I'm currently using Talend Open Studio for Big Data 7.3.1 and I don't see any component like thash*. Could you please suggest what could be the reason.

Re: Using tSchemaComplianceCheck for max length validation of integer/long

Anonymous — Wed, 31 Mar 2021 07:52:47 GMT

please read this KB article to active these two components.