Robots.txt is a text file which helps search engine bots to crawl your blog effectively. Using Robots.txt file you can stop crawling of any perticular part of your blog. For example if you are using any language translator plugin or have a print version of any webpage, using Robots.txt file you can stop crawling of such pages, as they may create post duplication issue. When we talk about WordPress, pages like Wp-admin, plugins folder are ...
→ 
→