topic How to Validate file schema with metadata schema in Talend Studio

How to Validate file schema with metadata schema

Anonymous — Fri, 09 Jun 2017 09:54:36 GMT

Hi,

I need to validate the Excel file schema with metadata schema

Please help me out to find the component which can do this ?

Re: How to Validate file schema with metadata schema

Anonymous — Fri, 09 Jun 2017 12:02:48 GMT

This can be done by using tSchemaComplianceCheck component available. This component validates the input schema with the schema defined on this component. Hence, the schema you have under metadata can be set on this component where your excel file can be main input of this component if I rightly understand what you are trying to do.

Re: How to Validate file schema with metadata schema

Anonymous — Mon, 12 Jun 2017 08:30:43 GMT

Thanks Pravin,

But i need to compare column list.

tSchemaComplianceCheck do we have any option ?

Re: How to Validate file schema with metadata schema

cterenzi — Mon, 12 Jun 2017 20:03:44 GMT

You want to compare the headers to an expected list of headers?

Re: How to Validate file schema with metadata schema

SachinD — Tue, 13 Jun 2017 05:59:18 GMT

I guess we can only compare, type/Nullable/length/Data Pattern through tSchemaComplianceCheck.

I hv achieved this by joining 1st complete row in input csv file and lookup with tFixedFlowInput

ex : BUSINESS_DAY|RECORD_COUNT|SALES_SUMSSSS9999 (input file 1st row)

with

BUSINESS_DAY|RECORD_COUNT|SALES_SUM (tfixedflowinput)

Re: How to Validate file schema with metadata schema

Anonymous — Tue, 13 Jun 2017 07:17:23 GMT

Yes we can compare only type,length,Data Pattern through tSchemaComplianceCheck,

is there any way to compare columns

Example:

In my metadata

In my file below are the columns

I need validate file schema with above metadata list.

Please suggest me. is there any way to do this?

Re: How to Validate file schema with metadata schema

Anonymous — Wed, 05 Jul 2017 10:24:16 GMT

Hello,

Could you please try to build a string from your reference data (concatenating all columns delimited by a delimiter in your file) and configure a tFileInputDelimited with the delimiter to a value what never occurs in the file to prevent field separation, set also the limit to 1?
As schema is set only on column, you will get the header as one line and now you can compare it with your reference header line.

Best regards

Sabrina

Re: How to Validate file schema with metadata schema

rsmits — Fri, 08 Sep 2017 18:49:42 GMT

Just take a look here: http://talendhowto.com/2017/09/06/check-csv-header-in-talend-open-studio/
I used this one, but replaced the tfixedinput by an input xml.