What Is The A Record & CNAME Difference?

I don't really want to give people my server ip but would it make a difference if I only allowed CName and not A Records on my site?