topic Re: How to check csv header names are valid in Talend Studio

How to check csv header names are valid

Anonymous — Sat, 16 Nov 2024 12:07:19 GMT

Hi,
I need to know if the csv file which is being processed has header names same as per expected.If the header names are different i need to reject the file.If the header names are same as per schema then the file is supposed to be processed.
Please advise how this can be done?

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 05:22:21 GMT

read a first row of the file using tFileInputFullRow component then check first row of the file with tJavaRow using string compare methods like "contains, equals, equals ignore case" and based on compared result you can process file or reject it.

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 06:24:22 GMT

But how to check if the field names are as per expected tFileInputDelimited schema?Or are we supposed to check with hardcoded names?Also how to check only header names matches?And also if valid i want to process the file as tFileInputDelimited

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 06:42:29 GMT

please design job as follows:
create boolean variable "result"
tFileInputFullRow----tJavaRow--tJava--if(false)--take action
|
If(True)
|
tFileInputDelimited
in tJavaRow use following code
------------------------------------------
context.result= line1.equalsIgnoreCase("col1,col2,col3");

in true If connector check variable value
-----------------------------------------------------
context.result==true

in False If connector check variable value
--------------------------------------------------------
context.result==false

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 10:02:15 GMT

hi all,
have a lookt at "tSchemaComplianceCheck" that is designed for that goal.
regards
laurent

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 10:26:54 GMT

if you have extra column at the end of header row then tSchemaComplianceCheckwill not reject your file as schema change, even it is work to reject rows not entire file.

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 11:12:09 GMT

Hi umeshrakhe,
Thanks i was able to handle my conditions with your previous solution.
And yes tSchemaComplianceCheck does not work with extrat columns.Also it was not validating field names.
Thanks a lot,
anaya

Re: How to check csv header names are valid

Anonymous — Tue, 15 Jan 2013 11:34:11 GMT

welcome..

Re: How to check csv header names are valid

Anonymous — Wed, 16 Jan 2013 11:58:42 GMT

hi all,
for extra column, you can use a referentiel schema to check against it.
I use to work with referenced against built-in to work with the up-to-date schema in my job.
regards
laurent

Re: How to check csv header names are valid

Anonymous — Fri, 23 Jan 2015 07:27:48 GMT

hi all,
have a lookt at "tSchemaComplianceCheck" that is designed for that goal.
regards
laurent

Hey Kzone,
As I know, tSchemaComplianceCheck can only used for below-
1. for max length
2. for date patterns
and can not used for column name validation.