Remove Pipe characters in field in a field separator

[desanip]

Talendians,

I have a question. How do i handle if there is a pipe in my field in my input file?

For example: 1234|DAVID|SCHRUTE|PARIS|FRANCE|EUR|OPE|215.555.32

Here, you can see DAVID|SCHRUTE is supposed to be the value of the field, however the pipe between DAVID and SCHRUTE is causing them to think its two different fields but its not. So how can i identify this row and reject the row and write to a file in Talend? Is there anything specific in settings that i could change?

Any help is appreciated.

[akumar2301]

if column having value "OPE" is mandatory , Th record will be rejected in any case by tFileInputDemilted.
because OPE will come as decimal which is not parsable.

[manodwhb]

@desanip , One way is you should request for the input data in text enclosure of "" then you can use the csv option of tfileinputdelimitted.

and the data should be like below

1234|"DAVID|SCHRUTE"|"PARIS"|"FRANCE"|"EUR"|"OPE"|215.555.32

[desanip]

@manodwhb  Is there anyway i can reject the record if i encounter pipe between my field? I am pipe as my delimiter too.

can talend handle this sort of requirement?

[manodwhb]

@desanip , may be you can try to check each row structure against schema in advanced setting of tFileinputDelimitted component and see you can take rejects from that component.

[akumar2301]

Hello I forgot to mention , if you want to put the record in reject select
"check each row structure against schema" in tFileInputDelimeter. This will send wrong schemas to reject flow.