Robot text this uses search engines to crawl websites. You can allow or disallow any directory or files from  list at search engines

Leave a Reply

Your email address will not be published. Required fields are marked *