topic Re: tFileInputDelimited cannot read currency signs in Talend Studio

tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 15 Nov 2024 23:58:13 GMT

Hi all,

I am using a tFileInputDelimited to read a csv-file, but with a tLogRow I can see certain signs are not read correctly. For example currency signs as well as quotes. I saw you can change the encoding of the input, but that doesn't solve the problem.

Does anyone know how this can be solved?

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 07:05:10 GMT

HI,

in the tFileInputDelimited basic settings , you can check csv options, a new field will appear with csv escape char : """ is selected by default,

it will suppresse all the double quote.

If is not ok could you send some data example

Send me Love and Kudos

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 07:22:33 GMT

Hi,

It seems it doesn't work. Here some requested data examples

“TB-0-0879-18 STONE’S OEE”

CC P&B (€/unit)

What I see in the tLogRow:

TB-0-0879-18 STONES OEE

CC P&B (/unit)

So all kinds of quotes and currency signs are gone.

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 07:43:56 GMT

have you tried : "ISO-8859-1" if you select CUSTOM in encoding ?

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 07:58:46 GMT

Yes I tried, but the results were the same

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 07:59:42 GMT

I try with "Cp1252" as CUSTOM ENCODING it works

so you can use tChangeFIleEncoding component with use Custom Input Encoding

as "Cp1252"

and output encoding as UTF-8 for example

it will better for you for the rest of the job € will appear on utf-8 now

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 08:12:07 GMT

This is my result

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 08:13:40 GMT

could you open it via notepad and look wich encoding you have ?

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 08:25:26 GMT

ANSI

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 08:29:10 GMT

could you send me the file but with just one or two lines ?

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 08:32:42 GMT

Sure!

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 08:33:56 GMT

cause if Cp1252 doesn't work for ANSi, i have to find the specific one ENCODING

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 08:38:36 GMT

I hope you can find it

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 10:07:45 GMT

here the result with cp1252 :

currency is ok

there is special char that are not double quote but Modifier Letter Double Apostrophe

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 10:25:58 GMT

I don't know why but I cannot manage to see the currency with cp1252 as I said earlier. Any idea what the reason could be?

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 10:39:39 GMT

you can try to add

-Dfile.encoding=UTF8

in your jvm parameters :

Run Tab -->Advanced sttings --> use specific JVM arguments --> new

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Fri, 09 Jul 2021 10:58:52 GMT

Unfortunately the same results...

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Fri, 09 Jul 2021 12:27:37 GMT

Hi ,your file is encoded in windows- 1250 , so it's "Cp1250"

Re: tFileInputDelimited cannot read currency signs

fovo1625813403 — Wed, 14 Jul 2021 14:32:35 GMT

Somehow I fixed it with CP1252. tLogRow doesn't show what I want to see, but when I write it to a database or tFileOutput everything seems to be OK.

Anyway, thanks for your help

Re: tFileInputDelimited cannot read currency signs

gjeremy1617088143 — Thu, 15 Jul 2021 08:00:52 GMT

Hi, i'm happy you succeed !

if one of my answer set you on the right path please select it as the best answer.

Send me Love and Kudos