Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Create powerful robots.txt files that help ensure that Google and other search engines crawl and index your site correctly.