Received fatal error (out of memory)

I was adding a gallery of images to my home page and have used the plugin grid gallery with custom links in the past but didn't think that plugin was activated. However, after making the edits and inserting the gallery of images, I received this error: Fatal error: Out of memory (allocated 78905344) (tried to allocate 122880 bytes) in /home/ldiederich/ecraftandshare.com/wp-admin/menu-header.php on line 107
I went into the ftp to delete the plugin but the error is still there and can't access full dashboard to get rid of the gallery I added. Not sure what to try next.