Comment by post-it
2 years ago
Have they hammered people's websites? I find that the Google bot makes as few requests as it can, and it respects robots.txt.
2 years ago
Have they hammered people's websites? I find that the Google bot makes as few requests as it can, and it respects robots.txt.
No comments yet
Contribute on Hacker News ↗