How to delete plugins safely

I want to delete the AddThis (and possibly another) plugin but want to do so safely. What is the best way to delete a plugin? My initial thought was to use FTP and delete the plugin folder and all files but I want to be sure first.