Found the solution,
I changed the way the second dimension (inside each bar) was created...
instead of just using :
Then in the Sorting area, selected Numeric Descending. Now each inner segment of each bar is sorted as required
I hope this helps someone else