[SmartCrawl] Indexing disabled

Indexing of the site has been disabled in SmartCrawl by adding a noindex attribute. I learned about that from SEO Scan in SmartCrawl.