Custom Sidebars not applying correct settings to HomePage

Ok, the homepage does not apply the correct sidebar.
Problem: I want to have the Main Sidebar to apply to all "Pages" and the Blog Sidebar to apply to all "Posts". But when I do this, the homepage (only the homepage, not other pages) displays the Blog Sidebar instead of the Main Sidebar.
Note: I have Wordpress settings to set the Homepage to a specific page.