topic Re: validate multiple excel files with different schema in Talend Studio

validate multiple excel files with different schema

srota25 — Sat, 16 Nov 2024 03:53:43 GMT

Hi All,

I have a requirement and I am finding it difficult to get the approach.

Scenario is : Need to validate the input source files which are in .xlsx format. The source files are with different schema structure. Need to build the reusable job kind of framework which will validate any set of input files with the list of validation

The validations are

1. File Name

2. SheetName

3.Column names

4. Nullability

5. Primary key check

The error details should be captured in a table when the validations fail for any file

Client wants the build should be in modular form so that any st of input files the same set of validations can be applied/reused.

Please help me in getting the approach

Re: validate multiple excel files with different schema

Anonymous — Tue, 17 Dec 2019 08:35:13 GMT

Hello,

Doing a Schema Validation, you could use tSchemaComplicanceCheck against the tFileInputExcel component. This component validates the input schema with the schema defined on this component. Hence, the schema you have under metadata can be set on this component where your excel file can be main input of this component if I rightly understand what you are trying to do.

Best regards

Sabrina

Re: validate multiple excel files with different schema

srota25 — Mon, 23 Dec 2019 21:34:26 GMT

My requirement is I have 3input source .xlxs files having different schema. As part of preprocessing need to validate the files and the validation rules include file name, sheet name, data type check.
Is there anyway to build a single Talend job and any input file can be validated using that job.