topic Reading and inserting arabic in Talend Studio

Reading and inserting arabic

Moe1 — Tue, 19 Sep 2017 11:33:41 GMT

Hi,

Im reading from AS400 one arabic field and inserting it into mysql DB, but it seems Im only getting gibberish with qestion marks?

Note: I tried to add into the (additional JDBC parameters) this string (useUnicode=true&characterEncoding=utf8) with no luck....

Hope someone could help.

Re: Reading and inserting arabic

jilanisyed — Tue, 19 Sep 2017 12:47:18 GMT

Your Mysql db also should accept UTF-8 characters. alter your table which field you need to load arabic data.

for your reference please see below query.

ALTER TABLE `database`.`table` MODIFY COLUMN col VARCHAR(255)
CHARACTER SET utf8 COLLATE utf8_general_ci NOT NULL;

Re: Reading and inserting arabic

Moe1 — Tue, 19 Sep 2017 13:14:48 GMT

Already done, with no luck

Re: Reading and inserting arabic

Moe1 — Tue, 19 Sep 2017 14:24:12 GMT

When using encoding cp1256 the display is ??? with some weird characters, while when using encoding utf8 the display is gibberish (only wired characters) .. Note that the AS400 file Im reading from has CCSID = 37

Re: Reading and inserting arabic

Anonymous — Wed, 20 Sep 2017 04:18:00 GMT

Hello,

Have you also tried to add the "Dfile.encoding=utf-8" to the JVM parameters to see if it works?

Best regards

Sabrina

Re: Reading and inserting arabic

Moe1 — Wed, 04 Oct 2017 17:00:46 GMT

Actually when I changed the CCSID to 420 on AS400 the encoding to cp1256 worked. It is weird that it does not work with the CCSID is 37