How can i restrict scraping my content from the content on directory listings

How can i restrict scraping my content from the content on directory listings

  • Alexander

    Hi @fyrumunna,

    You really can't. The only way to truly prevent scraping is to take the page offline. Just as a page can be shown in a browser, a computer can view the page, and parse it's source into just the content it needs.

    One thing you can do is make this quite a bit harder. Often scrapers work against Wordpress sites by pulling from the RSS feed. Wordpress adds a URL endpoint that allows a feed to be generated from a Wordpress query rather than parsing it through one of the theme's templates.

    visiting yoursite.com/listings/feed will give you all the site's listings.

    We can disable this, but it would affect all the feeds for the site. If this is something you'd like to do let me know and I can give further instruction.

    It's common for normal Wordpress posts, but quite uncommon for scrapers to hit the Directory listings feed as it's under a different URL. Honestly I wouldn't really recommend it unless you're noticing that your site is being misused.

    Thanks for being a WPMU DEV member. Let us know if we can be of any further assistance.
    Best regards,

Thank NAME, for their help.

Let NAME know exactly why they deserved these points.

Gift a custom amount of points.