Wednesday , 30 July 2014
Home » blogging » How to add & edit /robots.txt in Blogger blogspot blogs

How to add & edit /robots.txt in Blogger blogspot blogs

If you are a web master or blog owner, you must have probably heard about /robots.txt. It’s a text file that tells the search engine what to index and what not to. This will help the search engines to neglect the 404 error pages and other pages that you don’t want to be in search engines. Officially as per google, Robots.txt is defined as

robots.txt file restricts access to your site by search engine robots that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages. (All respectable robots will respect the directives in a robots.txt file, although some may interpret them differently. However, a robots.txt is not enforceable, and some spammers and other troublemakers may ignore it. For this reason, we recommend password protecting confidential information.)

They are a must for your blog in case of seo and all wordpress blogs have a strong robots.txt for the search engines. Now, blogger also have the same feature which you can use to enhance your seo and tell the search engine to skip your unwanted or 404 pages.

This is quite simple. Blogger has made this process also really simple as it always does ! Thanks to google.

  1. Login to your blogger account
  2. Go to settings of your blog
  3. Navigate to Search Preferences
  4. Select  custom robots.txt or Custom robots header tags.

 

If you use custom robots.txt, then you will have to manually create the robots file, which if you don’t know how to may create errors. So I prefer that you use the Custom robots header tag, where you can edit the robots.txt file completely by ticking the needed boxes. Take care while doing the same as errors in robots file could seriously affect your search engine rankings

About Rajeel

I'm Rajeel, a teen blogger from India who loves computers, sports, internet and all other kind of tech stuffs. This blog thing is one of my favourite hobby and the one that eats up much of my time. But Really, I'm loving it :) Find me in G+

3 comments

  1. Robot.txt is the file that contains the pages which should not be indexed or crawled. But this pages can still be give rank for the keywords. It will have the restrictions for the crawlers. It is usually used to controlled the behaviour of automated robots.

  2. Dear TeeN GeeK your post is excellent about edit robots.txt in Blogger blogspot blogs. but one more thing i want to know that how can i fix the same problem for my WordPress blog of going to the cpanel. i am very tired of searching and fixing the problem. will you make a post to solve the problem?Thanks for sharing me here.

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

CommentLuv badge

Scroll To Top