How to Handle Validating Excel Input where input format/schema changes during iteration
I'm having trouble gracefully handling changes in my Excel input during job execution. I have numerous monthly reports to ingest but the columns included in the reports is not static (they change between months). To cope with this I have used tSchemaComplianceCheck to validate the main flow after tFileInputExcel with 1 compliance check for each schema type I encounter in testing. My problem is the tFileInputExcel also has an input schema associated with itself so some rows are being rejected at this stage before they get into my schema checking stage.
What is best practice when dealing with changeable inputs during a job? and is it possible to stop Excel performing any checks so that at least all my rows pass through my schema compliance check
I just gave some examples. It doesn't need to be that many. Even if it is many if you specify the parameters and criteria right it shouldn't give a problem.
"i.e. could 2 columns be detected as 1? "
This will never happen as Excel is storing each and every column in separate cells.
