!!! Fighting hard with control characters !!!

[Anonymous]

Hi!
I'm running Talend 5.0.1 and I'm fighting hard to get rid of, or replace, control characters... This is what I have:
1. tMysqlInput reading from a MySQL database with an utf8_general_ci encoding where some of the characters appear as an "em symbol" in the query output
2. tReplace where I'm trying to replace "\u0025" with an emty string ""
3. tMap component
4. tAdvancedFileOutput where the output encoding is set to UTF8
I thought I'd remove the problem by enclose the text with "<!]>" but it didn't help - Furthermore the tReplace component seems to be unable to replace the single "em" character by looking for "\u0025". If I don't enclose the text with the CDATA directive I get written to the file which causes problems when I try to index the XML in another system...
Hope you're able to help me here because I'm 100% stuck with this...
Many thanks!

[Anonymous]

Hi
Now let's simplify this issue.
Show me details, such as Input Data, Expected Data.
Regards,
Pedro

[Anonymous]

Hi Pedro!

This is what it looks like:
Part of the data from MySQL: "... continued its mission..." - I believe the strange character getS encoded to "" when using a tAdvancedFileOutput component. I'd like to replace it with "'" or get rid of it altogether...
There are a number of similar characters but I thought that if I get rid of the one above first then I could use the same approach for the rest
Cheers!

[Anonymous]

Hi
Set tRaplace as the following image.
Don't check "Whole word".
Or I misunderstood what you mean?
Regards,
Pedro

[Anonymous]

Hi Pedro!
Thnaks for your suggestion. I do have a question though: the character I wanted to remove/replace was not the "..." but the single character that looked "strange" in my posting. The "..." was included to show that there were leading and trailing text
Cheers!

[Anonymous]

Hi
Got it this time.
Do as the image above.
I' m not sure whether tReplace can replace special character.
But you can try it.
The only thing is that don't check "Whole word".
Regards,
Pedro

[Anonymous]

Uh uh - this sounds a bit troublesome. Do you think I'm able to do something like this instead:
row2.Summary.replace("\u0025", "")
otherwise specify "\u0025" while using tReplace?
Cheers!

[Anonymous]

Hi
This issue is the same with Euro Symbol.
I tried to replace ? with "".
But unfortunately it doesn't work. I reported on BugTracker several days before.
You may try it with Java method.
Regards,
Pedro

[Anonymous]

Hi Pedro!
Many thanks for your help. I hope this get solved soon. In the meantime I need to find another solution...
Cheers

[janhess]

Is the data actually UTF8? If so it would display properly.