← Back to context Comment by mystraline 1 month ago https://news.ycombinator.com/item?id=46681454I think this is a recent change. 1 comment mystraline Reply daveoc64 1 month ago All the comments there seem to suggest that there has been no change and that robots.txt isn't required.
daveoc64 1 month ago All the comments there seem to suggest that there has been no change and that robots.txt isn't required.
All the comments there seem to suggest that there has been no change and that robots.txt isn't required.