Comment by remus
2 days ago
Indeed, I've got a site which gets a lot of bot traffic and google bot is pretty sensible compared to a lot of other mainstream bots.
2 days ago
Indeed, I've got a site which gets a lot of bot traffic and google bot is pretty sensible compared to a lot of other mainstream bots.
Yes, it really does not make that many requests. In fact lots of site owners struggle with having it not crawl and index their site enough