topic Re: Issue with special characters in delimited file input in Talend Studio

Issue with special characters in delimited file input

LMontesP — Sat, 16 Nov 2024 01:35:36 GMT

Hello,

I have a problem with a .csv file (encoding is ISO-8859-15) that I am trying to import using a tFileInputDelimited.

Some of the fields in this file contain special characters such as "=", and the component seems to have a problem with that.

I get this error when executing the job:

org.talend.designer.runprocess.ProcessorException: Job compile errors

At least job "test_job" has a compile errors, please fix and export again.

Error Line: 2565

Detail Message: Syntax error on token "=", Expression expected after this token

The issue is that I can't remove those characters (some are part of email addresses).

So what should I do? Transform the .csv into some other file format?

Or is there a way to escape those characters that I am not aware of? Can you help me, please?

Thank you in advance

Re: Issue with special characters in delimited file input

manodwhb — Wed, 26 Aug 2020 08:57:37 GMT

@Laura Montes , this is one way that you read entire file using tFileInputRaw and replace = with empty and then generate the file and read that file using tFileInputDelimited.

Thanks,

Manohar

Re: Issue with special characters in delimited file input

LMontesP — Wed, 26 Aug 2020 10:20:22 GMT

Thank you for your answer. However, my problem is that I can't simply remove those characters with empty because they are part of important fields (for example, I have at least one email that goes something like "example=mail@domain.com").

Do you think there is any way to make the tFileInputDelimited ignore or escape those = characters?

Re: Issue with special characters in delimited file input

manodwhb — Wed, 26 Aug 2020 10:23:58 GMT

@Laura Montes , You can try to using escape character.

Re: Issue with special characters in delimited file input

LMontesP — Wed, 02 Sep 2020 15:12:33 GMT

In the end I solved it by using the "Create file delimited" command in the Metadata submenu in the Repository.

When I import the delimited file this way, it works without an issue for some reason...