- Messages
- 764
- Reaction score
- 27
- Points
- 0
I don't know what Google have have done to their bot recently or maybe it's just my bad luck
but I have had the Googlebot go berserk trying to index one of my projects* over at another
web host and tripped the CPU useage limit. As a result I'm on suspension there lol!
So as a warning to others DO remember to set a custom crawl rate for your site in using the
Google Webmaster control panel because the bots can bite.
*Project 276: bishop.comxa.com
The unholy union of the Bing search and Google PDF reader API's.
but I have had the Googlebot go berserk trying to index one of my projects* over at another
web host and tripped the CPU useage limit. As a result I'm on suspension there lol!
So as a warning to others DO remember to set a custom crawl rate for your site in using the
Google Webmaster control panel because the bots can bite.
*Project 276: bishop.comxa.com
The unholy union of the Bing search and Google PDF reader API's.