← Back to context

Comment by stef25

15 hours ago

Isn't it just a question of pretending to be a search bot ? Sites will allow google bot to bypass the paywall so stuff gets indexed.

The owner must have subscriptions to these services. Some paywalls are absolute and it bypasses all of them with ease. I don't see it now but there was a time when archiving a reddit page showed the username that their bot was using.