I think it's possible what you are looking for. Take a look at this file where sliders store some temporal dimensions that are used in charts.
Note that I'm using calendar for dates because there are lots of them, and sliders for years because there are a few. The object is the same, it only varies the configuration (Slider/Calendar).
Hope that helps.
It wasn't exactly what I needed, but it did help me get to a solution! :) I ended up just using a master calendar as you had in your example and using the slider as a selection on the master calendar. I then had to use some logic in my charts (much as you did for the set analysis) in order to do the calculations right.
Appreciate the quick response!