Responsive themes - from a users perspective

I love the way a responsive theme can make your site look right on non pc devices....
But as a user, i find that when I am on my ipad and I go to a site with a responsive theme, I am not likely to stay long.
I cannot stretch the site to make the letters bigger, so it becomes a pain to read.
Maybe this has something to do with HOW people are making themes responsive, or maybe I am just not using them correctly...
Does anyone else feel that responsive should mean, not only responsive to the device, but responsive to the user?
End of rant... Lol,
Begining of discussion (I hope)