Displaying Slide In ONLY on certain posts

Hello,

I'm trying to achieve only having a slide in appear on certain posts.

I have a Slide in with setting "This is a post-specific slide-in" checked and I only have 1 post where I have selected it as the slide in, but it is showing up everywhere.

How can I get it to only show on the posts that I assign it to?

Thanks,
Jesse