sidebars for Marketpress shop pages

I have created a sidebar for the online store on our website and selected it for the main "store" page but does not appear. I would also like to have the same sidebar on all store pages, like the product pages. Is this possible? I couldn't find anything under "store settings". Thank you!