Earlier, we need to add Robot.txt as file into domain html file blah,blah… But by using the new tool on Blogger, users are allowed to add custom robot.txt for their blogs quickly and in simple manner. This post will be guiding you on this case! Before getting into the tutorial, you need to get some better idea on robot.txt, what is it?
What is robot.txt file?
Robot.txt is file where the blog owners or admin use this file to give instructions about their site to web robots. It can also stops web crawler software, such as Googlebot, from crawling certain pages of your site. It can make your blog SEO friendly too! It will be added next to the site link for example,
http://www.WebsiteName.com/robots.txt
Add Custom Robots.txt in Blogger
Step 1: Go To Blogger >> Setting >> Search Preference.
Step 2: Find Custom Robot.txt Section there and in the checkbox go ahead with YES. Then paste the following code added below in that box
User-agent: Mediapartners-Google
User-agent: *
Disallow: /search?q=*
Disallow: /*?updated-max=*
Allow: /
Sitemap: http://www.yourdmomain.com/feeds/posts/default?orderby=updated
Step 3: Then Save the Changes.
Final thoughts
Hope you benefited with this post by improving your blogs search preference using robot.txt. If you’ve any doubts on this, then drop them below. Don’t forget to share your thoughts in comments below. And do likes and share this post, if you feel this article helps! Happy and Peace Blogging;)
Thank you a lot for guiding Robot.txt in simple and effective manner.
Now i have made changes to my website for enhanced improvement over SEO development.