topic Displaying Unicode UTF-8 characters in QlikView in QlikView

Displaying Unicode UTF-8 characters in QlikView

Fri, 01 Oct 2010 09:07:47 GMT

I have a client who stores his data in Simplified Chinese, but it is in Unicode UTF-8 format. If it is in ASCII I can display it fine in QlikView, but unfortunately for operational reasons they must use the Unicode set. Does anyone know if there is a way to display this correctly?

Thanks in advance

Trevor Doble

Displaying Unicode UTF-8 characters in QlikView

Thu, 25 Nov 2010 15:00:36 GMT

Hi Trevordoble,

even I am stucked with same issue, can you please share if you come across any resolution or helpful information on this sofar?

Thank you,

Rajesh.

Displaying Unicode UTF-8 characters in QlikView

Fri, 24 Jun 2011 19:05:04 GMT

Having the same problem. I appreciate any insights you may have in resolving this issue.

Jeff G

Displaying Unicode UTF-8 characters in QlikView

kaushiknsolanki — Fri, 24 Jun 2011 19:31:45 GMT

Hi,

You can try below.

load * from a.txt (CodePage is 10000, txt, delimiter is ',' , no labels)

Where Code Page are

1200 — UTF-16LE Unicode little-endian
1201 — UTF-16BE Unicode big-endian
65000 — UTF-7 Unicode
65001 — UTF-8 Unicode
10000 — Macintosh Roman encoding (followed by several other Mac character sets)
10007 — Macintosh Cyrillic encoding
10029 — Macintosh Central European encoding
20127 — US-ASCII The classic US 7 bit character set with no char larger than 127
28591 — ISO-8859-1 (followed by ISO-8859-2 to ISO-8859-15)

Regards,

Kaushik Solanki

Displaying Unicode UTF-8 characters in QlikView

Fri, 24 Jun 2011 19:35:47 GMT

Kaushik,

thank you for the info. I've tried to use the UTF-8 unicode but when I do it translates the chinese into wacky characters, not chinese characters. I used the applycodepage function on the field I have in my data model.

What's weird, and it's stated in my other post, is that while I get blocks in qlikview when I attempt no encoding changes, if I export from the table to Excel the chinese characters show up fine in Excel.

Thoughts?

Cheers,

Jeff G

Re: Displaying Unicode UTF-8 characters in QlikView

Fri, 24 Jun 2011 19:36:15 GMT

Kaushik,

Thoughts?

Cheers,

Jeff G

Displaying Unicode UTF-8 characters in QlikView

kaushiknsolanki — Fri, 24 Jun 2011 19:40:08 GMT

Hi,

Can you please upload data and qvd file.

That will be helpful for me to understand the problem.

Regards,

Kaushik Solanki

Re: Displaying Unicode UTF-8 characters in QlikView

Fri, 24 Jun 2011 19:48:34 GMT

I solved it...

It appears that Qlikview 9 SR3 at least doesn't behave the same as Excel when translating characters.

I had to go into Regional and Language Settings in the control panel, Languages tab.

In the Languages tab is a check box for supplemental language support for east asia. I checked it, rebooted and the characters are showing up correctly now.

Displaying Unicode UTF-8 characters in QlikView

Thu, 25 Aug 2011 12:49:23 GMT

Hi Jeffrey,

I am writing to you because I am facing a similar issue. I am using ODBC to pull data from a DB2 database in Qlikview. The table contains few columns that are Chinese caracters. I have windows 7 OS on my machine with Qlikview 9 SR6. Itried installing the Asian language on windows butr still problem exists.

I get ODBC error when I try to run the script to create a QVD. If I download the data in to Excel and then load in to Qlivkiew it works. IT also displays Chinese characters.

Can you tell me how you solved the problem ?

1) Are you using the code page function ?

2) Are you using the Asia language setting ?

Any help appreciated. Thanks

Mandar

Displaying Unicode UTF-8 characters in QlikView

Thu, 25 Aug 2011 13:06:33 GMT

Hi Mandar,

For me it was as simple as what I described above. I have attached a screenshot. As far as the ODBC, can you connect to another source or pull in data from another table that doesn't contain Chinese characters?

Have you tried an OLEDB connection to see if that works? Do you want to upload your QVW code and I can take a look at it?

Here is the screenshot.

Displaying Unicode UTF-8 characters in QlikView

Thu, 25 Aug 2011 14:56:54 GMT

Hi Jeffrey,

There is something new I learned. Turns out Qlikview is not complaining for Chinese characters. It is something else...

So basically in my test I created a QV script to load only one field from the source table. This field contains Chinese characters. When I run the script it loaded all the rows in the table and displays Chinese as well. When I modify the script to load all the fields from the source table and then try to load. This time it loaded only 1800 rows. Also gave the error. So the error is something to do with the size of data. Here is the log file....

8/25/2011 10:52:47 AM: Execution started.

8/25/2011 10:52:47 AM: QlikView Version:9.00.7646.9

8/25/2011 10:52:47 AM: 0002 SET ThousandSep=','

8/25/2011 10:52:47 AM: 0003 SET DecimalSep='.'

8/25/2011 10:52:47 AM: 0004 SET MoneyThousandSep=','

8/25/2011 10:52:47 AM: 0005 SET MoneyDecimalSep='.'

8/25/2011 10:52:47 AM: 0006 SET MoneyFormat='$#,##0.00;($#,##0.00)'

8/25/2011 10:52:47 AM: 0007 SET TimeFormat='h:mm:ss TT'

8/25/2011 10:52:47 AM: 0008 SET DateFormat='M/D/YYYY'

8/25/2011 10:52:47 AM: 0009 SET TimestampFormat='M/D/YYYY h:mm:ss[.fff] TT'

8/25/2011 10:52:47 AM: 0010 SET MonthNames='Jan;Feb;Mar;Apr;May;Jun;Jul;Aug;Sep;Oct;Nov;Dec'

8/25/2011 10:52:47 AM: 0011 SET DayNames='Mon;Tue;Wed;Thu;Fri;Sat;Sun'

8/25/2011 10:52:47 AM: 0013 ODBC CONNECT*XUserId*XPassword*

8/25/2011 10:52:47 AM: 0021 SQL SELECT *

8/25/2011 10:52:47 AM: 0022 FROM S102LAPM.JDEINTLIB.F5682QV

8/25/2011 10:52:48 AM: 98 fields found: WFSRP3, W1DL01, WFSRP2, W2DL01, WFSRP1, W3DL01, WFDOCO, WFDCTO, WFKCOO, WFNAME, WFLNID, WFLNTY, WFROUT, WFPRP1, WFDESC, WFVR01, WFMCU, WFTRDJ, WFDRQJ, WFADDJ, WFDGL, WFIVD, WFDGJ, WFDOC, WFDCT, WFORIG, W4DL01, WFLITM, WFAITM, WFDSC1, WFDSC2, WFAC03, WFAN8, WFALPH, WFAC11, W5DL01, WFSHAN, W2ALPH, WFAC13, W6DL01, WFDL01, WFADD1, WFADD2, WFADD3, WFADD4, WFDL02, WFCTY1, WFLOTN, WFLOCN, WFNXTR, W7DL01, WFLTTR, W8DL01, WFUORG, WFSOQS, WFSOBK, WFCRCD, WFTXR1, WFUPRC, WFFEP, WFAEXP, W2AEXP, W3AEXP, W4AEXP, WFUNCS, WFECST, W5AEXP, W6AEXP, WFRATE, WFLPRC, W7AEXP, WFFUP, WFFEA, W8AEXP, WFFUC, WFFEC, W9AEXP, WFSRP7, W2UNCS, WAAEXP, WFSLSM, WFALP1, WFAC02, W9DL01, WFSLM2, W3ALPH, WFPTC, WFDTE, WFANFL, WFCCPR, WFAC14, WADL01, WFOPRD, WFRMK, WFVEND, W2VEND, WFPRP2, WFUPMJ, SQL Error:[IBM][System i Access ODBC Driver]Error in assignment.

SQL Scriptline:

SQL State:22005

8/25/2011 10:52:52 AM: Error: ODBC read failed

8/25/2011 10:52:54 AM: 0026 If ScriptErrorCount = 0 then

8/25/2011 10:52:55 AM: Execution finished.

Re: Displaying Unicode UTF-8 characters in QlikView

Anonymous — Mon, 08 May 2017 18:30:31 GMT

Hello,

I have the same problem with Unicode characters.

I have a SQL server database which is contain of a large data where most of them are Unicode and has the nchar data type.

Unfortunately when i load them by LOAD SQL statement , it shows "?????" instead of the Unicode texts.

Also I changed Windows language and setting but nothing changed.

Re: Displaying Unicode UTF-8 characters in QlikView

Anonymous — Fri, 12 May 2017 18:28:45 GMT

Hello,

I solved my problem by creating second Table with Nvarchar Type In sql server as this:

IF EXISTS(SELECT * FROM NewTbl)

DROP TABLE NewTbl

SELECT

field1,field2,,

convert(nvarchar(50),Field3) Field3

INTO [MyDb].dbo.NewTbl

FROM [MyDb].dbo.PreviousTbl;