Comment by sunaookami

They serve a different robots.txt to Google: https://merj.com/blog/investigating-reddits-robots-txt-cloak...

You can see it here: https://search.google.com/test/rich-results/result?id=_mYogl... (click on "View Tested Page")