Course that is not published is showing up on course pages

I've got a test course I was using, and I unpublished it, but it still shows up for a non-logged-in user on the courses page. What's up?