In fact I do not need a clean and neat, and I accept workaround. I guess some advanced formula with set analysis may help, but I do not know how that could be applied. The problem I have is that we had a old BI tool just allow us to do sorting by column on demand, and we think QV is a better tool and should be able to that as well.
In the below 2 video's Christof Schwarz shows some workarounds in order to get a pivot table to sort any way you want it. I think the 1st might apply more to your requirement, in that you enable the customer to sort by any column (ascending or descending) by a simple click.