Does any of you out there know anything about a robot file? If so I would like for your help with something. Seems that my other blog got left out of the page ranking update this time. So I decided to go to Google Webmasters Tools and see what the problem was. For some reason, Google bot was blocked from the site. I checked all of my settings in my profile and everything was the was it was suppose to be. I am not that savvy when it comes to IT things but I do have a little common sense. Using the blogger platform the only control you have when it comes to the upper level programming of your site is by either clicking yes or no on the settings page. All of the yes and no questions where correct.
I ran a couple of more diagnostic programs and found out that there was a robot file that was blocking post that had a certain label on them. How this came about I have no idea. So I went in and deleted all of the labels, Google bot was still blocked. After about a hour of with a headache I finally decided to look at the post that had the label that was blocked. I went in a removed the formatting on a post that was a copy and paste post from a contest. After doing this I re-checked to see if Google bot was still blocked. This cleared up the problem and it is now allowed. Although I will probably have to wait 2 more months to get a page rank, at least I have the problem solved for now. If anyone can enlighten me on the subject please feel free to let me know. Thanks
Wednesday, April 30, 2008
Subscribe to:
Post Comments (Atom)
4 comments:
robots.txt is a file used to prevent indexing of pages you do not want Google using to judge your site. For WP you would not want google indexing the admin pages of your site for example.
It took me 24hrs to get google to recheck a robots.txt file that was blocking it.
I am not sure how a single post could block Google from an entire site.
Yeah, robots.txt basically tells Google bots (and other search engines bots) what contents on your site can be crawled and what's not.
So if you put a wrong entry in there, you may block the whole access to your site if not careful!
Do some search on robots.txt if you want to know more about it
robot.txt are pretty easy files.
They are a text file that basically has this:
User-agent: *
Disallow: /Name_Of_Folder
Disallow: Name_Of_File
No real need to put "allow" in, since anything that is not listed under "disallow" will get indexed. Just remember to put the / in front of any folder you do not want indexed. Save it in your root directory as robots.txt, and update it as necessary.
Here is a great place to get help with all your google questions
http://groups.google.com/group/Google_Webmaster_Help?msg=subscribe
Post a Comment