I found the solution to this issue. It comes from Windows internet options handling of mixed content. To fix it, open up "Internet Options" (from either the control panel or IE). Click on the "Security" tab. With the internet zone selected, click on the "Custom level..." button. Scroll down in the list for "Display Mixed Content" and select "Enable".
If you are running Win 2008, you'll need to disable IE Enhanced Security Configuration: