Checking for Source Schema changes

Alator20 — Fri, 15 Nov 2024 22:26:07 GMT

HI! newbie here with a quick question.

If I wanted to implement a check that validates the header of the source file to check if there is any additional columns added or if the order of the columns have changed.

Basically after my tFileinputdelemited I want to add this check, and if it fails then die and send email to our prod team to fix. If it doesn't fail then continue with the flow. I dont want to add dynamic schema as I have to do transformations on the fields in tMap and from my understanding you cant with dynamic schema.

Is there any components that might help with this task?

Any assistance would be appreciated. Thanks!

Re: Checking for Source Schema changes

Anonymous — Sun, 23 Oct 2022 16:30:29 GMT

Hello,

I'd take a look at tFileInputFullRow component. https://help.talend.com/r/en-US/8.0/fullrow/tfileinputfullrow-tlogrow-textractdelimitedfields-textractregexfields-reading-full-rows-in-delimited-file-standard-component-create

By reading the header line you could calculate if it matches your expectation (number of columns, order, etc)

Cheers,

Balázs

topic Re: Checking for Source Schema changes in Talend Studio

Checking for Source Schema changes

Re: Checking for Source Schema changes