topic Re: [resolved] problem with tMysqlOutput and Encoding in Talend Studio

[resolved] problem with tMysqlOutput and Encoding

Anonymous — Sat, 16 Nov 2024 13:14:34 GMT

Firstly, I would like to say hello. I am new to the forums and new to Talend.
I have been encountering a problem, and I am unsure if something is wrong or if I have missed a step.
I need export data from Excel to MySQL. The part data contain Russian characters.
Tracert in inside TOS - all look well.
Result in table of MySql is wrong.
Does anyone know what the problem is?

Re: [resolved] problem with tMysqlOutput and Encoding

Anonymous — Thu, 21 Oct 2010 20:44:07 GMT

problem solving - need pass the jdbc parameter to force utf8 encoding "noDatetimeStringSync=true&characterEncoding=utf8"

Re: [resolved] problem with tMysqlOutput and Encoding

Anonymous — Fri, 22 Oct 2010 18:35:01 GMT

Vik,
I tried your solution - it does not work for me. I have the same set as yours: data flows from Excel into MySQL table.
I have slight difference - there are couple other components in between.
tFileInputExcel --> tFilterRow --> tMap -->tMysqlOutput
Encoding = UTF8 is set on tFileInputExcel and tMysqlOutput components. I added your suggestion: "noDatetimeStringSync=true&characterEncoding=utf8"
and doesn't seem to work.
Is there anything else you did?
Thank you for your help!
Peter.

Re: [resolved] problem with tMysqlOutput and Encoding

Anonymous — Fri, 22 Oct 2010 20:12:18 GMT

Hi, Peter.
Sorry for my English.
In the beginning, I have many variants job. The result was identical - bad.
After parameter addition all was normalized.
When the parameter isn't present, Talend send to MySql string "SET NAMES latin1".
After parameter addition "characterEncoding=utf8" - Talend any more doesn't send a line "SET NAMES latin1"
I think that further, the coding established on the server is important.
In my case, I have next MySql serever parameters - DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci.

Vik

Re: [resolved] problem with tMysqlOutput and Encoding

Anonymous — Thu, 27 Jun 2013 11:41:24 GMT

Hi Once try with this.....this worked for me....
add "useOldUTF8Behavior=true" in JDBC additional parameter....

Re: [resolved] problem with tMysqlOutput and Encoding

Anonymous — Fri, 30 Jan 2015 06:36:49 GMT

Hi everyone,
I am having an issue with my job.
I am sending the records to SharePoint using tSoap. My records are having some international characters (like Ö etc.)
When I am running the webservice job through Talend Open Studio I am not getting any error. But when I am running the same job from Windows Scheduler using services it is not supporting those international characters, I am getting below error :

SUPPLIER Webservice Job 2015-01-29 14:50:00 Starting Job
0
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenverver</faultcode><faultstring>com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 middle byte 0x54 (at char #319, byte #127)</faultstring><detail /></soapenv:Fault>
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenverver</faultcode><faultstring>java.lang.ArrayIndexOutOfBoundsException: read(buf,-380,4380), cbuf</faultstring><detail /></soapenv:Fault>
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenverver</faultcode><faultstring>com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 middle byte 0x50 (at char #315, byte #127)</faultstring><detail /></soapenv:Fault>
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenverver</faultcode><faultstring>java.lang.ArrayIndexOutOfBoundsException: read(buf,-380,4380), cbuf</faultstring><detail /></soapenv:Fault>
|<nsutSUPPLIERResponse xmlns:ns=""><ns:return xmlns:xsi="" xsi:type="ns:Return_Status"><ns:Errors>Error while updating row 0 for DataElement with meta id 213051, Message: Cannot insert the value NULL into column 'PARMA_CODE', table 'PPSS_qa2.dbo.MR_SUPPLIER'; column does not allow nulls. INSERT fails., Error Code: 515, SQL: INSERT INTO MR_SUPPLIER (PARMA_CODE, PARMA_DESC, LAST_UPDATED_BY, LAST_UPDATE_DATE, CREATED_BY, CREATE_DATE, EMAIL, FAX_NUMBER, TELEPHONE_NUMBER, INBOUND_FREIGHT_GROUP, COUNTRY, ZIP_CODE, STATE, CITY, ADDRESS2, ADDRESS1, EXTRACTION_TIME) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
ColumnARMA_CODE, Value:null
ColumnARMA_DESC, Value:null
Column:LAST_UPDATED_BY, Value:null
Column:LAST_UPDATE_DATE, Value:null
Column:CREATED_BY, Value:null
Column:CREATE_DATE, Value:null
Column:EMAIL, Value:null
Column:FAX_NUMBER, Value:null
Column:TELEPHONE_NUMBER, Value:null
Column:INBOUND_FREIGHT_GROUP, Value:null
Column:COUNTRY, Value:null
Column:ZIP_CODE, Value:null
ColumnTATE, Value:null
Column:CITY, Value:null
Column:ADDRESS2, Value:null
Column:ADDRESS1, Value:1
Column:EXTRACTION_TIME, Value:null</ns:Errors><ns:Num_Deletes>0</ns:Num_Deletes><ns:Num_Inserts>0</ns:Num_Inserts><ns:Num_Updates>0</ns:Num_Updates><ns:Record_Name>SUPPLIER</ns:Record_Name></ns:return></nsutSUPPLIERResponse>|
SUPPLIER Webservice Job 2015-01-29 14:50:01 Ending Job

Do I need to check some setting or something to make it work.

Any suggestion would be appreciated, Thanks in advance.

Cheers,
Shilly

Re: [resolved] problem with tMysqlOutput and Encoding

Anonymous — Fri, 04 May 2018 07:25:38 GMT

Thanks, i was try a lot of things and this one work for me.