I am not really sure about your list box that counts the numbers, are you using an expression together with the date field in that list box?
Anyway, I would try starting with a pivot table chart object, then use your date field and the Yes/No field as dimensions.
Create one expression (the one you are using in the list box, something like count(FIELD) )
Then drag the Yes/No dimension to the top (click on the dimension header and drag with the mouse while keeping mouse button pressed).
Hope this helps,
Sorry I don't quite understand where and what to drag...
I don't know if I was very clear. What I was hoping for was instead of having yes/no as the column name (with yes/no repeated over and over again throughout the column), but instead to have one column named yes, and another that has no, and just have counts beneath them.