topic Re: tAzureSynapseInput with special characters in Talend Studio

tAzureSynapseInput with special characters

Burgo — Fri, 15 Nov 2024 22:27:16 GMT

Hi everyone,

i have the following example data in a SQL table:

{àèéìòù}

and then following piece of code:

If i run my job with Talend i have the same data, but if i run my job via scheduled task or cmd i have the following:

There is something i can do to replace them?

Thanks

Re: tAzureSynapseInput with special characters

Anonymous — Tue, 18 Oct 2022 04:11:03 GMT

Hello,

Please make sure that the Studio run with the java property "-Dfile.encoding=UTF-8" in .ini file.

It will handle correctly Non English characters and the .bat is created to deal with the java to be used by Studio.

Best regards

Sabrina

Re: tAzureSynapseInput with special characters

Burgo — Tue, 18 Oct 2022 09:56:31 GMT

Hi Sabrina,

thanks for the reply.

In TOS_ESB-win-x86_64.ini file i've already that line:

I've tried adding the same line in .bat and this is the result running it:

Thanks.

Re: tAzureSynapseInput with special characters

Anonymous — Wed, 19 Oct 2022 08:22:12 GMT

Hello,

Could you also try to solve the problem by editing the job *.bat file in a notepad and adding -Dfile.encoding=utf8 after the java word?

Feel free to let us know if this solution works?

Best regards

Sabrina

Re: tAzureSynapseInput with special characters

Burgo — Wed, 19 Oct 2022 16:10:38 GMT

Hi Sabrina,

i've already tried, like you see in my previous post, and the final result is this:

Thanks.

Re: tAzureSynapseInput with special characters

Anonymous — Thu, 20 Oct 2022 06:36:17 GMT

Hello,

Does it work in .bat file when using tfileinputXXX component with special characters instead of tAzureSynapseInput?

Best regards

Sabrina

Re: tAzureSynapseInput with special characters

Burgo — Thu, 20 Oct 2022 14:10:50 GMT

Hi Sabrina,

thanks for the reply.

With tFileInputDelimited i've the exact same behaviour:

1) Run from Talend --> OK:

2) Run from cmd without adding -Dfile.encoding=utf8 --> KO:

3) run from cmd adding -Dfile.encoding=utf8 --> KO:

Thanks.

Re: tAzureSynapseInput with special characters

Anonymous — Fri, 21 Oct 2022 05:04:58 GMT

Hello,

In Talend studio, please go to: "File -> edit project properties -> build -> shell -> bat" and then you have to add this line "-Dfile.encoding=utf-8" after "java" like shown in the attached file. This option will start the CMD with UTF-8 encoding.

Re: tAzureSynapseInput with special characters

Burgo — Fri, 21 Oct 2022 07:56:25 GMT

Hi Sabrina,

done like you said but same behaviour (like editing .bat directly) again:

Thanks.

Re: tAzureSynapseInput with special characters

Anonymous — Fri, 21 Oct 2022 08:09:39 GMT

Hello,

Have you tried to use utf-8-BOM?

For more information about Unicode character encoding, please have a look at this documentation

https://www.w3.org/International/articles/definitions-characters/

Hope it will help.

Best regards

Sabrina

Re: tAzureSynapseInput with special characters

Burgo — Wed, 26 Oct 2022 09:25:50 GMT

Hi Sabrina,

same situation (added via edit bat properties from file menu):

Thanks.

Re: tAzureSynapseInput with special characters

Anonymous — Fri, 28 Oct 2022 09:49:05 GMT

Hello,

Sorry for getting back to you so late. I will try to make a testing on it to see if it is a bug in talend for this situation and come back to you asap.

Best regards

Sabrina