How do I change the page titles?

My register page (and any other new page I create) has the title "enter your new page title here". How do I control this? I tried changing it from the WP admin area with no luck. Possible bug?