Robot is simply a software of Google Search Engine which is send by Google to collect information from all the websites which are newly discovered. I have already discussed about Crawling and Indexing in my previous post. Now I'm going to discuss about how to add Custom robot text to blogger.
Before starting first we have to know about Custom Text. Custom text is the direction to the Robot software that how it crawl the site which is given by the administrator. It allows Robot to crawl and index maximum number of pages from the website. So it essential for the Search Engine Optimization (SEO).
How to add Custom Robot.txt to Blogger blog:
There is no hardness to add this text which can be done even a beginner. So lets go the steps:
- Go to the Dashboard and select Settings from the left bar.
- Select Search preference from submenu.
- At the right, go to the Crawlers and Indexing section.
- Click edit in Custom robot.txt and select yes.
- Add this code given below in the box which will appear just below the Custom robot.txt.
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search?q=*
Disallow: /*?updated-max=*
Allow: /
Sitemap: http://www.technocarebd.blogspot.com/feeds/posts/default?orderby=updated
Note: Red line denotes the link of your sitemap URL/RSS feed URL.Disallow:
User-agent: *
Disallow: /search?q=*
Disallow: /*?updated-max=*
Allow: /
Sitemap: http://www.technocarebd.blogspot.com/feeds/posts/default?orderby=updated
Now you have almost done.
Now take a look what you have done.
Click Save Changes.
Copyright Technocarebd 2013
