This is the way that Qlik Sense works.
White means that you have active data and can pick one of these choices.
Grey means that the data is not available but is in the data that was loaded.
It may be possible to limit to just the 3 by coding an expression in your Time filter instead of just displaying the Time field. But I don't know your data.