How to use robots.txt
robots.txt files are files that you can upload to the root directory of your website that tell web crawlers what parts of your website they are allowed to crawl.
Link to bestspace Tips:
http://howco.de/tips
Don't forget to subscribe for more!