[SmartCrawl Pro] robots.txt Editor


Smartcrawl often pings the fact that there is no link to the sitemap.xml file in robots.txt. However, there doesn't seem to be a way to edit that within Smartcrawl itself which seems a strange omission. I think Yoast allows this and I guess that if this is something you advise (Yoast doesn't incidentally, although I don't think it would hurt) you should probably have an editor in there. On my site for example if I FTP looking for the robots.txt file, it isn't there, so must be getting generated from somewhere.