Get menu of separate blog in Multisite

I'm trying to figure out a way to include a menu from the main blog into a separate sub blog.

Since things like menus and widgets get loaded differently, switch_to_blog() wont work.

Another option I want to avoid is to use file_get_contents() to the main blog to return just the HTML of a defined menu. Not wanting to load WordPress twice or three times per page load..

Anyone have a solution?