topic Re: How to handle data in different language ? in Talend Studio

How to handle data in different language ?

prabuj — Fri, 15 Nov 2024 21:46:41 GMT

Dear Team, @richard Hall @Xiaodi Shi @Shicong Hong

I have data for some of the columns it's in different language. The language is "THAI". When I try to load the data to a excel sheet, the FNAME, LNAME columns data looks bad.

If ID is less than 13 digits, then concatenate FNAME+LNAME+DOB and keep it in CID.

If ID is more than 13 digits, then concatenate FNAME+LNAME+DOB and keep it in CID.

If ID is equal to 13 digits, then keep the 13 digits in CID.

If ID is null, then concatenate FNAME+LNAME+DOB and keep it in CID.

Thanks in advance.

Re: How to handle data in different language ?

Anonymous — Wed, 24 May 2023 04:39:38 GMT

@prakhar dubey write the ternary expression in CID expression field on tMap, eg:

row1.ID==null?(row1.FNAME+" "+row1.LNAME+" "+row1.DOB):(row1.ID.length()==13?row1.id:row1.FNAME+" "+row1.LNAME+" "+row1.DOB)

Can you please try and let me know if you have any problems?

Regards

Shong

Re: How to handle data in different language ?

prabuj — Wed, 24 May 2023 06:21:07 GMT

@Shicong Hong The information in Thai ( FOREIGN LANGUAGE IS NOT DISPLAYED )

Thanks in advance.

Re: How to handle data in different language ?

Anonymous — Wed, 24 May 2023 07:44:48 GMT

Have you tried to use 'UTF-8' encoding to read the data from data source? Take a look at this similar question, it might be helpful.

Regards

Shong

Re: How to handle data in different language ?

prabuj — Wed, 24 May 2023 08:27:07 GMT

@Shicong Hong

I kept the encoding as "UTF-8" . THE LANGUAGE IS "THAI"

Thanks in advance

Re: How to handle data in different language ?

Anonymous — Wed, 24 May 2023 10:17:49 GMT

What is the encoding of file? You can open the file with notepad++ and click the 'Encoding' tab to see the file encoding.

Re: How to handle data in different language ?

prabuj — Thu, 25 May 2023 03:10:53 GMT

@Shicong Hong I try to check with the "GOOGLE SEARCH", since I don't have permission to install notepad++ . THAI LANGUAGE encoding is "TIS-620"

I tried changing the encoding with TIS-620 , I can able to see the information, but the information looks somewhat sloppy. ( YOU CAN SEE ON THE SCREENSHOT), the characters looks pretty small.

May I know ? How reliable it will be - when I try to do some functions with it .. like concatenation, splitting the name. ? Will it work out, since the "THAI" language encoding is not in Talend.

Thanks in advance.

Re: How to handle data in different language ?

Anonymous — Thu, 25 May 2023 07:19:09 GMT

I have never processed THAI language, but I see THAI characters always looks small. After reading the data with 'TIS-620' encoding, any problem you have when you try to some function with the data?

Re: How to handle data in different language ?

prabuj — Thu, 25 May 2023 07:39:57 GMT

Looks good at the moment. !

Appreciate your efforts and replying towards every comment. The code which you share for concatenation, works ! Thanks @Shicong Hong

Re: How to handle data in different language ?

Anonymous — Thu, 25 May 2023 10:51:15 GMT

Great, glad to hear that!