Checking for Source Schema changes

[Alator20]

HI! newbie here with a quick question.

If I wanted to implement a check that validates the header of the source file to check if there is any additional columns added or if the order of the columns have changed.

Basically after my tFileinputdelemited I want to add this check, and if it fails then die and send email to our prod team to fix. If it doesn't fail then continue with the flow. I dont want to add dynamic schema as I have to do transformations on the fields in tMap and from my understanding you cant with dynamic schema.

Is there any components that might help with this task?

Any assistance would be appreciated. Thanks!

[Anonymous · Accepted solution]

Hello,

I'd take a look at tFileInputFullRow component. https://help.talend.com/r/en-US/8.0/fullrow/tfileinputfullrow-tlogrow-textractdelimitedfields-textractregexfields-reading-full-rows-in-delimited-file-standard-component-create

By reading the header line you could calculate if it matches your expectation (number of columns, order, etc)

Cheers,

Balázs