topic Re: Convert non-UTF8 encoded files to UTF-8 encoded format in Talend Studio

Convert non-UTF8 encoded files to UTF-8 encoded format

Anonymous — Sat, 16 Nov 2024 11:14:40 GMT

Is there a way to Convert non-UTF8 encoded files to UTF-8 encoded format for Hadoop to parse the file efficiently
And replace the hexadecimal Field and Record delimiters to proper format in UTF-8 encoding? Can you illustrate thru an example?

Re: Convert non-UTF8 encoded files to UTF-8 encoded format

Anonymous — Tue, 21 Apr 2015 04:36:31 GMT

Hi,
Have you checked component TalendHelpCenter:tChangeFileEncoding which transforms the character encoding of a given file and generates a new file with the transformed character encoding.
Best regards
Sabrina

Re: Convert non-UTF8 encoded files to UTF-8 encoded format

Anonymous — Mon, 25 Feb 2019 11:33:56 GMT

Hi Guys,

I am extracting data from json files with tFileInputJson component, it is not extracting UTF-8 Charcters by printing the output in tLogRow or tMySQLOutput. I have tried to change the encoding in advance settings but it didn't worked too.

Your help would be appriciated.

Thanks and Regards

Hitesh Mundra

Re: Convert non-UTF8 encoded files to UTF-8 encoded format

Anonymous — Mon, 25 Feb 2019 17:21:56 GMT

Hi Hitesh,

Did you change the file encoding for the component to UTF-8 as shown below?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Convert non-UTF8 encoded files to UTF-8 encoded format

Anonymous — Mon, 25 Feb 2019 17:25:07 GMT

Hi @nthampi , I have already tried this but didn't worked.

Re: Convert non-UTF8 encoded files to UTF-8 encoded format

akumar2301 — Mon, 25 Feb 2019 20:46:04 GMT

Did you already try tchangefileencoding?

Otherwise try routine attached in below link

https://community.talend.com/t5/Design-and-Development/tChangeFileEncoding-and-UTF8-encoding/m-p/149125#M91288

Otherwise Attach a sample file

Re: Convert non-UTF8 encoded files to UTF-8 encoded format

Anonymous — Thu, 02 May 2019 09:50:35 GMT

Hi,

I have solved the issue by simply read file with tFileInputRaw and write tFileOutputRaw with UTF-8 Charcter set. This solved the issue.

Thanks and Regards

Hitesh Mundra