Creating a simple Contact Management System

I want to create a simple CMS for the site and was hoping to do it in WP. I just want simple tracking info like "i called them" "What is sent" and "when to follow up." Is there a simplified down CMS like Sugar anyone knows of? Or, how I could build one? I have 700 or so contact to import.