DATA duplicacy issue.

[#1]

HI ,

AS i have a issue of data dupliaccy in my dashboard.like my data source is excel  . so if user put different name file  but both are having same data  so how can i avaoid it. and how can i maintain intergrity in dashbaord ??

Or

anything that will indicate the data duplicacy

Any suggestion ???

[its_anandrjs]

Use master file and load data with Load Distinct and create a QVD first then load the data will be better way for this type of file.

[Anonymous]

Hi,

You may use "Distinct" during data loading in application. This will eliminate duplicate records from table.

Load Distinct

     .....

FROM <Table>

[#4]

What Anand suggests will always work, but in order to ensure better data quality I recomend that you clear the duplicates from the excel file (if possible). To detect them you could use QlikView. You could do something like this:

If the example excel file looks like this:

Load it like this:

LOAD

     Name,

     //Rest of excel fileds needed if they exist
     1 as CountDuplicates //Field to check for duplicates

FROM
test.xlsx

(ooxml, embedded labels, table is Hoja1);

Then in create a Table chart with the dimensions form your excel file and the following expression:

sum(CountDuplicates)

The result should be something similar to this:

[jansen28]

Try:

File1:

LOAD Field1,

     Field2

FROM

TableA;

File2:

LOAD Field1 as Field1_T,

     Field2 as Field2_T

FROM

TableB;

LOAD *

Resident File2

Where not Exists(Field1,Field1_T);

DROP Table File2;