Comment by topranks

3 days ago

Sure.

It might be a tool in the box. But it’s still cat and mouse.

In my place we quickly concluded the scrapers have tons of compute and the “proof-of-work” aspect was meaningless to them. It’s simply the “response from site changed, need to change our scraping code” aspect that helps.