Create a Robots.txt File to Avoid Duplicate Content and Boost WordPress SEO

Robots.txt is a simple text file that you upload to your server root. It contains instructions for search engines indexing your site, ie. follow that link, don’t index this directory, etc. You can get help creating a WordPress-specific robots.txt file at Ask Apache: Robots.txt For WordPress. Discussion is open below in the comments if you want to add to this tip.

Want to Submit a Daily Tip to

If you’ve got a great tip for WordPress, WPMU, or BuddyPress users, send it our way on Twitter: @wpmuorg and we’ll happily credit you. Create a tweetable title and let us know if you have a more info or an article you’d like to link it to.