Comment by mystraline 13 days ago https://news.ycombinator.com/item?id=46681454I think this is a recent change. 1 comment mystraline Reply daveoc64 13 days ago All the comments there seem to suggest that there has been no change and that robots.txt isn't required.
daveoc64 13 days ago All the comments there seem to suggest that there has been no change and that robots.txt isn't required.
All the comments there seem to suggest that there has been no change and that robots.txt isn't required.