Joining Data/ Unique values

[Anonymous]

So I am joining two tables that I need to have in a qvw then export.  There is a field in both of the sets of data that have duplicate values. What would be the best strategy in removing the duplicates. What it be using a DISTINCT expression either in the load script or the table box itself?

[jpapador]

You could do a LOAD Distinct, but that may not work.  Why are the values in the table non-distinct?

[Anonymous]

The load distinct value didn't work. I made a list box of the field that the values need to be unique and used show frequency and saw that there were still duplicates.

The values are non distinct because both tables contain the same field but one table has values the other doesn't.

[JonnyPoole]

Are these date fields or date/ time fields ?  If yes, you'll need to round them to whole dates with floor() .  

Load Distinct should remove duplicate rows , if all the values of all the fields in the load are the same.

Can you post a sample ?

You can also use a group by in the load to aggregate fields together but you'll need to use summary functions (sum() ) to aggregate the numerics.

[saurabh5]

are the two field date fields?

can u place an example of the field values to look for a solution.