validate multiple excel files with different schema
Hi All,
I have a requirement and I am finding it difficult to get the approach.
Scenario is : Need to validate the input source files which are in .xlsx format. The source files are with different schema structure. Need to build the reusable job kind of framework which will validate any set of input files with the list of validation
The validations are
1. File Name
2. SheetName
3.Column names
4. Nullability
5. Primary key check
The error details should be captured in a table when the validations fail for any file
Client wants the build should be in modular form so that any st of input files the same set of validations can be applied/reused.
Doing a Schema Validation, you could use tSchemaComplicanceCheck against the tFileInputExcel component. This component validates the input schema with the schema defined on this component. Hence, the schema you have under metadata can be set on this component where your excel file can be main input of this component if I rightly understand what you are trying to do.
My requirement is I have 3input source .xlxs files having different schema. As part of preprocessing need to validate the files and the validation rules include file name, sheet name, data type check. Is there anyway to build a single Talend job and any input file can be validated using that job.
