Can't use WP Super Cache and AVH from Comment Spam Pack at the same time

I need some advice on how to work around an issue I ran into.

I was using WP Super Cache and the Comment Spam Pack (using Project Honey Pot and stopforumspam). I went to my site today and saw that I was blocked access because my IP was detected by Project Honey Pot or stopforumspam. Upon closer inspection I realized that the IP mentioned wasn’t mine and that I was looking at a cached page!

Do you use both of these plugins at EduBlogs? How do you work around this scenario?

I could try to avoid caching the homepage, but I assume that is usually the page with the most need of caching? That also wouldn’t help other pages that might get stuck in a “denied access” cache state.