More on Google and Control
January 26, 2009
Search Engine Journal’s “Unable to Change Googlebot Crawl Rate via Google Webmaster Tools” provides some insight into Google’s ability to implement variable controls. The article addresses the situation in which a Webmaster wants Google’s indexing robot to “crawl faster”. For some Webmasters, the Google administrative controls don’t work. Ann Smarty provides some information about this situation. She ignores one reason of which I thought: Google wants to control what happens with regards to indexing a specific site. The GOOG’s ability to implement fine grained controls makes clear what Google’s resources for control of its sprawling infrastructure is revealed in this write up in my opinion.
Stephen Arnold, January 26, 2009