Comment by claytonjy
18 hours ago
What sorts of sites are you thinking of? To me, “most useful to a programmer” evokes docs and blogs and github issues and forum posts. I suppose some forums might be AI-resistant (login wall), but the others are trivially AI accessible.
Plenty of Linux-y websites use Anubis. Arch Wiki and IIRC some other distros too.
That's less a value judgment, more a necessary evil due to the plethora of bad actors out there. I doubt it will get in the way of a local model used in a reasonable manner.
Most wikis you can mirror locally if you really need to hammer them.
GitHub is naturally LLM resistant via its new uptime feature… I’ll show myself out.