Not able to remove the duplicates

[NavinReddy]

Dear Experts,

Can you please help me how to remove duplicate values from Script side.

i tried with distinct function again im getting duplicate values on dashboard.

any suggesions

LOAD Distinct

     Market_ID,

     Manuf_ID,

     Categ_ID,

     Brand_ID,

     SuBBrand_ID,

     SKU_ID,

     [Value Offtake (000 Rs.)],

     [Sales Volume (Volume (KG))],

     [Time Period],

     Corporation_Value_Sales,

     Corporation_Volume_Sales,

     Market_Value_Sales,

     Market_Volume_Sales,

     State_Corp_Value_Sales,

     State_Corp_Volume_Sales,

     State_Value_Sales,

     State_Volume_Sales,

     Brand_Value_Sales,

     Brand_Volume_Sales,

     SuBBrand_Value_Sales,

     SuBBrand_Volume_Sales,

     SKU_Value_Sales,

     SKU_Volume_Sales,

     Marketless_Value_Sales,

     Marketless_Volume_Sales,

     State_SKU_Value_Sales,

     State_SKU_Volume_Sales,

     Marketless_State_SKU_Val,

     Marketless_State_SKU_Vol,

     Ped_Val_Sal,

     Ped_Vol_Sal,

     [State Corp Val Share],

     [State Corp Vol Share],

     Record_Val_Share,

     Record_Vol_Share,

     Rank_Val,

     Rank_Vol,

     No_of_Stores,

     Num_D,

     Wtd_D,

     SAH_Val,

     Shipments_Val,

     Shipments_Vol

FROM

(qvd);

Best Regards,

Niranjan

[sunny_talwar]

Are you sure that there are duplicates? Would you be able to share your application to show the duplicates?

[NavinReddy]

yes i have in my application.

for security reason we are not suppose to share

im very sorry

Regards,

Niranjan

[sunny_talwar]

May be following the steps here can help you with your security concerns

Preparing examples for Upload - Reduction and Data Scrambling