For Duplicate Check

Tue, 07 Jul 2015 06:42:07 GMT

Dear All

I have a dimension (number) in which there is duplicate number repeated many times how i find it,and in another column i want the status

Re: For Duplicate Check

Kushal_Chawda — Tue, 07 Jul 2015 07:18:19 GMT

try,

Temp_Data:

LOAD * Inline [

Number

12345

12356

15879

98754

15879

15897

12345

98745

65987

46878

98754

15897

65987

15879];

Duplicate1:

LOAD Number,count(Number) as Cnt

Resident Temp_Data

Group by Number;

Duplicate:

LOAD Number,

'Duplicate' as status

Resident Duplicate1

where Cnt>1;

DROP Table Duplicate1;

Concatenate

LOAD Distinct Number,

'N' as status

Resident Temp_Data;

DROP Table Temp_Data;