topic Validations in Big Data Batch Job in Talend Studio

Validations in Big Data Batch Job

Anonymous — Sat, 16 Nov 2024 08:57:32 GMT

Hi Team,

I have development experience with Talend standard jobs but I am new to developing Big Data Batch Jobs in Talend. I have used tschemacompliance to validate schema data types and lengths in standard jobs in Talend. I am looking for an equivalent component in Big Data Batch job. Can you please help me understand how best we can achieve data type and length validations in a batch job? Looking forward for a timely response.

Thanks and Regards,

Shiv Soni

Re: Validations in Big Data Batch Job

Anonymous — Wed, 13 Dec 2017 04:04:53 GMT

Hi,

Can anyone help with this please?

Re: Validations in Big Data Batch Job

Anonymous — Wed, 13 Dec 2017 08:39:23 GMT

Hello,

The tschemacompliance component is a DI component and will not available in bigdata spark job, so far.

Have you tried to utilize a DI Job to orchestrate your spark job by using tRunJob component?

Best regards

Sabrina