{"id":44968554,"user":"semiquaver","time":1755744121,"time_ago":"3 days ago","type":"comment","content":"

Rot13 a challenge string. It could be any arbitrary function.","comments":[{"id":44968646,"user":"loloquwowndueo","time":1755745183,"time_ago":"3 days ago","type":"comment","content":"

That wouldn’t have the fallback rate-limiting functionality. It’s too cheap.","comments":[{"id":44968745,"user":"elcritch","time":1755746545,"time_ago":"3 days ago","type":"comment","content":"

It’s too cheap as a rate limiter as it is if you read TFA.","comments":[{"id":44969091,"user":"trenchpilgrim","time":1755751342,"time_ago":"3 days ago","type":"comment","content":"

That's a configurable setting.","comments":[{"id":44972631,"user":"semiquaver","time":1755783424,"time_ago":"2 days ago","type":"comment","content":"

There’s no possible setting that would make it expensive enough to deter AI scrapers while preserving an acceptable user experience. The more zeros you add the more real users suffer, despite not creating much of a challenge to datacenter-hosted scrapers.","comments":[{"id":44972820,"user":"loloquwowndueo","time":1755784406,"time_ago":"2 days ago","type":"comment","content":"

Real users suffer much more if the site is entirely down due to being DDoSed by aggressive AI scrapers.","comments":[{"id":44980405,"user":"semiquaver","time":1755829170,"time_ago":"2 days ago","type":"comment","content":"

Yeah, and if this tool doesn’t stop them then the site is down anyway.","comments":[{"id":44988753,"user":"raiph","time":1755890636,"time_ago":"a day ago","type":"comment","content":"

Right. The choice is presumably between:

Bad: A site being usable for a significant amount of time per day, but also unusable for a significant amount of time per day, and the ratio between usable and unusable time per day significantly deteriorating.

Worse: A site being usable for a significant amount of time per day, but also unusable for a significant amount of time per day, and the ratio between usable and unusable time per day significantly deteriorating _significantly faster_.

Clearly, Anubis is at best an interim measure. The interim period might not be significant.

But it might be. That is presumably the point of Anubis.

That said, the only time I've heard of Anubis being tried was when Perl's MetaCPAN became ever more unusable over the summer. [0]

Unfortunately Anubis and Fastly fought, and Fastly won. [1]

----

[0] https://www.perl.com/article/metacpan-traffic-crisis/

[1] https://www.reddit.com/r/perl/comments/1mbzrjo/metacpans_tra...","comments":[],"comments_count":0,"level":6,"url":"item?id=44988753"}],"comments_count":1,"level":5,"url":"item?id=44980405"}],"comments_count":2,"level":4,"url":"item?id=44972820"}],"comments_count":3,"level":3,"url":"item?id=44972631"}],"comments_count":4,"level":2,"url":"item?id=44969091"}],"comments_count":5,"level":1,"url":"item?id=44968745"}],"comments_count":6,"level":0,"url":"item?id=44968646"}],"comments_count":7,"url":"item?id=44968554"}

Comment by semiquaver