Comment by kibae
15 hours ago
Cloudflare, Azure, AWS, and Google Cloud all have a similar uptick in reported errors around 7:30. I suspect an outage on Cloudflare or another load-bearing service cascaded through all the major cloud providers.
https://downdetector.com/status/cloudflare/
https://downdetector.com/status/windows-azure/
I think down detector doesn't actually have any probes or actual insight into status etc. I think it uses search volume on its own service as a proxy for an outage - so if e.g. lots of people rush to down detector to query to see if SERVICE_FOO is down, it will register as an outage on down detector because loads of people are trying to see if there is an outage even if SERVICE_FOO is actually totally fine.
My hunch is everyone saw that openai and Claude were down and checked for Gemini too. I was using Gemini the whole time this happened without a blip so it certainly wasn't down in my region at least. 3.8 flash is pretty good and didn't miss a beat.
Down detector is a self-reported platform, they use a baseline over 6 months from user reports to try to automatically "detect" if there is a real outage, or if its just a couple end-users. Ultimately, the outage is entirely based on users going to down detector and clicking on "Report a Problem".
https://downdetector.com.py/en/methodology/
Huh. I thought they used to also do sentiment analysis of social media (Twitter, at least). I see that they definitely don't today, but has that always been the case?
So Down Detector is a kind of quantum observation experiment, observing influences the result.
Yes, but is it a load-bearing seam?
You are right, it is. They have now landed a clean fix.
They're saving a memory so this can't happen again.
4 replies →
It's really interesting to crawl through the web of phrases that seem "common" to each person in their interactions... I suspect if one were to get to the more niche "meme" phrases that people encounter, it starts to say more about the sort of person the LLM assumes it's speaking to, and perhaps something about their psychological profile...
It must be tuned for rage-based engagement because Claude only ever uses the most obnoxious Claudisms on me despite constant reminders to knock it off.
You're right to push back. This is bending the leaf on both ends... just my honest take.
It's a load-bearing poster.
I need to take a step back.
Hang on — I can apply a double tracked fix to the load bearing path, gated by provenance.
5 replies →
This entire thread is amazing!
It's like a kaleidoscope: Human words --> LLM Training --> chatbot-isms --> lovely parody catch-phrases (and this thread will get ingested soon, and be used to train...)
Honestly, this is worth looking at — with one caveat.
That's on me. I've been giving confident advice that doesn't hold up in practice.
1 reply →
May need to be fail-closed.
The load-bearing seam stays, not taking that away;
it was at least another thing worth flagging
Cloudflare CTO claims that it's not them
https://x.com/dok2001/status/2095538619603628388?s=46&t=ec6p...
https://nitter.kareem.one/dok2001/status/2095538619603628388
Surprised there's instances still up
1 reply →
Will the post-mortem reveal they all relied on a service running on a Macbook in a break room with a "Do not turn off" sign taped to it?
Someone probably set it to "magic", when everyone knows its supposed to be set to "more magic".
They should've used Greg's Optiplex.
Actually it said "Beware of the Leopard".
If it was still running snow leopard that would explain it
1 reply →
Have a hundred upvotes
[flagged]
[flagged]
Evidently it annoyed you enough to create one too. Remember, guys, there's one more day until Friday!
2 replies →
Cloudfare did release an update for their "HTTP/3 issue affecting R2 custom domains" around that time
https://www.cloudflarestatus.com/history?type=incident
LOAD BEARING
my money is on DNS
there is a haiku about this
https://xkcd.com/2347/ Nebraska man retired
Maybe a three-line npm package sneezed.
Maybe .unwrap()
1 reply →
Not retired, just switching careers. He's sick of this AI bullshit
great fun
Dane says Cloudflare has no service disruptions: https://x.com/dok2001/status/2095538619603628388?s=20
The internet is not supposed to work like this. The network was designed for robustness and fault tolerance, which allows it to reroute data if parts of the network fail.
Why are we all depending on one entity for it all to work? Makes me mad.
The System economically rewards those who successfully build Room-641A-as-a-Service
Because more fasterer and more cheaperer.
I hope Reticulum gains traction.
It's also easier to understand. For the internet to be fault tolerant you have to get rid of CDNs and assume everyone needs the same thing. That's more expensive than a centralized "internet" which relies on CDNs and fiber paths exclusive to the regions with most demand. Everything has been optimized for throughput for what is determined to be important, not rare fault tolerance
1 reply →
Why Reticulum when we have IP?
4 replies →
Because by re-centralizing everything you're not at a competitive disadvantage if you're down since everyone else is down, too.
Oh boy, the internet is anything but what it was supposed to be. I can't really bring myself to remember without feeling bad about it. The centralization, the power of certain businesses, the surveillance, dark patterns everywhere. Hell, you catch people simping for billionaires and asking, "Is that legal?" to scraping posts. Here. In HACKER news. So yeah. Depressing.
> asking, "Is that legal?" to scraping posts. Here. In HACKER news.
The capital letters don't make this astonishing. The padmapper vs. craigslist debate was nearly 15 years ago, most people were on craigslist's side (including me) and it was about somebody who was running a site in a less optimal but more human way vs. some startup looking for hockey-sticks.
But I was literally simping for the billionaire (maybe not quite yet then, don't know for sure if he managed it since) against scrapers. They were very much for-profit scrapers, unlike nitter, but the truth is the truth.
The only reason I support scraping Twitter is because it's yet another communications monopoly that was endlessly pushed on us by governments and massive corporations, even though it never made money, and once it finally got traction its priorities were to trash interop and manipulate content. The government should be dictating an interop protocol and expecting everyone to follow it, and instead it is encouraging media monopolies because they are an end run around the first amendment.
If the government created interop protocols for rental property, I'd have been against craigslist. Instead, it seemed very much like some startup play to steal craigslist's content to hopefully bury them, then sell on a valuation that included abusing their new monopoly and making us very much miss craigslist.
Sadly, facebook corralled and trained so many people for so long that their marketplace eventually killed craigslist for most things anyway (didn't have to buy padmapper after all.)
We're back to aol #keyword internet gatekeeping
We don't need to gatekeep the internet, cloudflare does that for us
Most of the internet continued to work just fine
> load-bearing service
do you generate training data for claude as a job?
Not really. The impact isn't as big too - Codex for example did not stop working for me.
https://updog.ai/
what's updog?
gottem!
:)
oh well, if it is working for you, then we are saved.
[flagged]
They simply shared their experience. I would’ve thought it’s a full-blown outage, but clearly not.
You stepped in the room real stinky here. What’s with the attitude?
2 replies →
“load bearing” :)
For once it’s appropriately used.
i wouldn't take you down. you're a load-bearing poster
What's the other way it's used?
LLMs (at least Claude) tends to overuse that significantly
6 replies →
In every document created by Claude.
I have never seen Claude use this phrase
3 replies →
It's a good metaphor and I refuse to let AI ruin it for me.
Years ago, when I worked at Stripe (which had a somewhat unique and inventive lexicon) it was a common term. “Is this jank load-bearing?” someone might ask.
I added a specific rule to disallow saying “load bearing”. So Claude is now saying “load handling”
1 reply →
But have we found the seams yet though?
4 replies →
Kids In The Hall had a sketch about overuse of a word or phrase [1]. This is the world that Claude is building for us.
[1] https://www.youtube.com/watch?v=lStcwT_RGrQ
It doesn't have to ruin it for you, but people are going to assume comments with it are AI generated.
1 reply →
We need a Samwise "Bear the load!" meme
3 replies →
Wait, why would it ruin it?
3 replies →
I still winced
claude code users at couldfare might've been thinking claude is specifically about them and see nothing wrong like other ppl do
[dead]