Comment by _heimdall
2 hours ago
For the LLM use, the challenge is that it will only discover those after first requesting and parsing the HTML version.
Maybe it will notice those, and maybe it will figure out the pattern for follow-up page requests, but there's no guarantee and it won't help the first request.
Not necessarily. They could also send a HEAD request to the URL first, to see the headers only and decide on the available alternates.
I am well aware that few sites are taking that much care of their API in terms of HTTP features, but all of the problems discussed here have solid and battle-tested answers.