topic Re: Data Corruption Issue in QlikView

Data Corruption Issue

spring101 — Wed, 02 Nov 2016 19:05:08 GMT

Good Afternoon,

We have run into an issue where a QVD loader builds bad data every other run. Some of the values that are populated are as follows:

|MN|-6|1

|MD|-5|1

These field values should be (and the format is always the same as #####A):

12346e

23423c

23423e

88932e

12300c

99824c

Has anyone ever run into this? It's very odd in that if I were to rerun this loader these records would be fixed. Also, other fields on the same rows are sometimes corrupted (such as persons names). This loader builds a QVD with about 480,000 records.

Thanks!

Tom

Re: Data Corruption Issue

johnw — Wed, 02 Nov 2016 19:21:23 GMT

I'm confused by the data you ARE getting, and it only happening every other run. But I do understand why QlikView would have problems with these values. Records that have all numeric digits with a single e, c, or d in them (?) are interpreted as some sort of exponential numeric format. If that's what's going wrong, the solution is to wrap the field in text() when reading it in so that QlikView doesn't try to interpret the data numerically.

Re: Data Corruption Issue

spring101 — Fri, 04 Nov 2016 14:35:34 GMT

I'm going to say that this helped though it is such an inconsistent issue it's hard to know that this was or will be the fix. The good news is that in the past couple of days with this change I've not seen any errors.