topic DATA duplicacy issue. in QlikView

DATA duplicacy issue.

Wed, 30 Jul 2014 06:52:33 GMT

HI ,

AS i have a issue of data dupliaccy in my dashboard.like my data source is excel . so if user put different name file but both are having same data so how can i avaoid it. and how can i maintain intergrity in dashbaord ??

anything that will indicate the data duplicacy

Any suggestion ???

Re: DATA duplicacy issue.

its_anandrjs — Wed, 30 Jul 2014 07:01:35 GMT

Use master file and load data with Load Distinct and create a QVD first then load the data will be better way for this type of file.

Re: DATA duplicacy issue.

Anonymous — Wed, 30 Jul 2014 07:03:31 GMT

Hi,

You may use "Distinct" during data loading in application. This will eliminate duplicate records from table.

Load Distinct

.....

FROM <Table>

Re: DATA duplicacy issue.

Wed, 30 Jul 2014 07:19:23 GMT

What Anand suggests will always work, but in order to ensure better data quality I recomend that you clear the duplicates from the excel file (if possible). To detect them you could use QlikView. You could do something like this:

If the example excel file looks like this:

Load it like this:

LOAD

Name,

//Rest of excel fileds needed if they exist
1 as CountDuplicates //Field to check for duplicates

FROM
test.xlsx

(ooxml, embedded labels, table is Hoja1);

Then in create a Table chart with the dimensions form your excel file and the following expression:

sum(CountDuplicates)

The result should be something similar to this:

Re: DATA duplicacy issue.

jansen28 — Wed, 30 Jul 2014 07:21:44 GMT

Try:

File1:

LOAD Field1,

Field2

FROM

TableA;

File2:

LOAD Field1 as Field1_T,

Field2 as Field2_T

FROM

TableB;

LOAD *

Resident File2

Where not Exists(Field1,Field1_T);

DROP Table File2;