topic Re: Check the encoding of text file in Talend Studio

Check the encoding of text file

BhavikaW — Sat, 16 Nov 2024 02:08:55 GMT

Hello,

I need to check the encoding of text file that whether it is UTF 8 with BOM or UTF 8 without BOM or ANSI and further proceed based upon the result.

I could not find the code to check for UTF without BOM or ANSi encoding. can anyone please help with this issue. I am using tchangefileencoding to convert the textfile but before that i need to detect the encoding.

Regards,

BhavikaW

Re: Check the encoding of text file

Anonymous — Fri, 19 Jun 2020 09:18:21 GMT

Hi
I search and find some third party library can used to check the encoding, such as ICU4J, refer to the discussions on stackoverflow.
https://stackoverflow.com/questions/499010/java-how-to-determine-the-correct-charset-encoding-of-a-stream
https://stackoverflow.com/questions/3684530/how-to-detect-the-character-encoding-of-a-file

In Talend job, you can use a tJava or write a user routine to hard code to detect the encoding. You may try it!

Regards
Shong