Comment by JimDabell

11 days ago

> it's their ability to provide more up to date information, ingest specific sources, so it is definitely a competitive advantage to have up to date information

My point is that you wouldn’t expect any one of them to be so much better than the others at crawling that it would give them an advantage. It’s just overhead. They all have to do it, but it doesn’t put any of them ahead.

> for a website owner there is zero value of having their content indexed by AI bots. Zilch.

Earning money is not the only reason to have a website. Some people just want to distribute information.

> Earning money is not the only reason to have a website. Some people just want to distribute information.

yes, I just want my hosting costs covered, and that is all. Otherwise you are paying for people to steal the info you "just want to share", the info the others make a profit on... that business model is absurd.

> My point is that you wouldn’t expect any one of them to be so much better than the others at crawling that it would give them an advantage

And why not?