← Back to context Comment by mystraline 6 hours ago https://news.ycombinator.com/item?id=46681454I think this is a recent change. 1 comment mystraline Reply daveoc64 6 hours ago All the comments there seem to suggest that there has been no change and that robots.txt isn't required.
daveoc64 6 hours ago All the comments there seem to suggest that there has been no change and that robots.txt isn't required.
All the comments there seem to suggest that there has been no change and that robots.txt isn't required.