In blogger it is known as Custom Robots.txt that means now you can customize this file according to your choice.
Webmaster crawl your site automatically and find your Robot.txt. If you are setting this than don't worried, your page Indexed automatically. Robot.txt file definitely Increase your SEO. You can find appropriate visitors enable this features on Blogger.......
What is Robots.txt?
Robots.txt file instruct the search engine bot and tells them which parts of the blog should be access and which parts of the blog should be blocked from indexing forever. Step By Step i will tell you how to enable custom robrts.txt.....
<<<<How to add Enable Custom Robots.txt File In Blogger>>>>
1. Go to Blogger Dashboard
2. See left side Setting option
3. Click search preferences
4. click custom robot.txt edit right side select yes....you will see a box showing you paste below code on box..
User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: http://stariz-net.blogspot.com/feeds/posts/default?orderby=UPDATED |
5. Replace the red color my blog name your own blog address....
6. Finally save click on save and you have done almost....
User-agent Mediapartners-Google : This is a first command which is for those blogs which are using Google AdSense if you are not using Google AdSense then remove it. If you are Using google adsense than serve better ads on your blog.
User-agent: * Here the User-agent is calling the robot and * is for all the search engine's robots like Google, Yahoo Bing etc.
Disallow: /search: This line tells the search engine's crawler not to crawl the search pages.
Allow: / This one allows to index the homepage or your blog.
Sitemap So this last command tells the search engine's crawler to index the every new or updated post.
It is simple task you want to robot can not crawl my about me page just follow this guideline
<<<Disallow: /p/about me.html>>>
This sitemap will only tell the web crawlers about the recent 25 posts. If you want to increase the number of link in your sitemap then replace default sitemap with below one.
Just copy and past your address bar than press enter you are done. Web crawler index your new post automatically you dont need to do anything...............Happy.....................
It will work for first 500 recent posts...........
Sitemap: http://example.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500 |
If you have more than 500 published posts in your blog then you can use two sitemaps like below
Sitemap: http://example.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500 Sitemap: http://example.blogspot.com/atom.xml?redirect=false&start-index=500&max-results=1000 |
No comments:
Post a Comment