Comment by elzbardico

It would be nice if not for the detail that nobody is using an LLM to crawl the internet as it would be an absurdly inneficient use of resources for a task that can be done with deterministic code.

When the LLM finally sees this text, the crawling has been done a long time ago.