Comment by sandblast
15 hours ago
No, in fact I don't. But this post wouldn't be of any help anyway. It feels like it's about nothing, there is no substance, just stating some obvious facts. Without examples that lead to some real recommendations, this whole expertise claimed by the author is of no use.
> expertise claimed by the author
The author is on record as trying to remove HTTP 418 "I'm a teapot" support from NodeJS, which resulted in backlash and Python adding support for it.
https://en.wikipedia.org/wiki/Hyper_Text_Coffee_Pot_Control_...
Wow. Talk about a storm in a teapot...
Back in 2018 when the internet wasn't completely fun, but still more fun than today...
Not many people could have gotten that done. Sounds like expertise to me.
That's harsh. I believe the author really does get questions from people who want to register a well known path, and probably some of them really failed to consider sites with ~user paths or whathaveyou and this post might push them to use a better solution.
And if you read that and still feel confident that you want a well known url, he links you to the registration process.
The point of the post was that you need to add robots.txt (or similar) because it's a thing, and also tell us where they are.
> add a robots.txt
Which bots will then ignore.