Ultimate Facebook plugin, wordpress comments won't go away!

I have ticked the box in the plugin setup

"Override WordPress discussion settings" which is supposed to turn off the wordpress comments and just leave the Facebook ones there.

The Facebook comments are showing up fine but the wordpress ones are still there too

Any ideas?