How to remove duplicate records

[Kohli]

I have table like  SID, SNAME,

SID, SNAME, SMARKS

1, Hari, 30

2, Sourav, 55

3, Sachin, 75

3, Sachin, 75

4. Mahesh, 65:

I got ID (3) in multiple times. i want remove that duplicate values.

[petter]

SID seems to be a unique identifier that could be used to check against to identify duplicates.

LOAD

  *

FROM

  [.....]

WHERE

  Not(Exists(SID));

[jomar_ebonite]

Hi,

Try to use distinct in Load Script.

LOAD Distinct
*

FROM

[thannila]

Try this Below Code:

Data:

load * Inline

[

SID, SNAME, SMARKS

1, Hari, 30

2, Sourav, 55

3, Sachin, 75

3, Sachin, 75

4, Mahesh, 65

];

RIGHT JOIN(Data)

Data1:

load distinct SID,SNAME

resident Data;