← Back to context

Comment by josefritzishere

8 days ago

The irony is that their AI bots still hoover up all your site content regardless.

Two different teams, I suppose. It is quite common in such a big company.

  • No need to simp for a megacorp. No matter how much these extremely well-paid US tech workers blame the "organizatioN" for their unethical behavior.

According to Gemini it uses the googlebot cache but it will fetch on demand when it's missing and the user asks for a summary. There are separate UAs you would need to block for those, Googlebot (search) and Google-Extended (AI summaries)