how to eliminate duplicate values from while loading

vinod22kv — Mon, 02 Oct 2017 12:17:41 GMT

can we eliminate duplicate values from while loading its self. please let me know.

Regards,

Vinod

Re: how to eliminate duplicate values from while loading

swuehl — Mon, 02 Oct 2017 16:34:45 GMT

Can you be a bit more specific about your issue and the requested outcome?

To eliminate duplicate records, you can use a distinct load:

LOAD DISTINCT

FieldA,

FieldB,

...

FROM ...;

To only load the first record in load order for a specific non-key field value:

LOAD

FieldA,

FieldB,

...

FROM ...

WHERE NOT EXISTS(FieldA);

edit: or maybe something completely different depending on your requirements