Comment by glimshe
1 day ago
Why didn't Claude detect the hack and prevent it from affecting customers using its superhuman AGI reasoning?
1 day ago
Why didn't Claude detect the hack and prevent it from affecting customers using its superhuman AGI reasoning?
Don't worry, I assume an LLM version of McAfee Total Protection Antivirus is coming soon
I do have a log reading / action / resolution product in the works.
Its sort of like having a sysadmin constantly watching. Poking through logs pcaps & monitoring for unusual activities.
Also works with local models well enough.
I love how LLMs have brought DIY software back. Need an app? Just make it. Like back when you’d write programs in BASIC
3 replies →
That's cute but bill for going thru even tens of log lines per second gonna be more expensive than entire rest of the infrastructure.
1 reply →
I’ve set up something like that with Opus. Works well enough, and points out CVEs to fix on the regular.
Running NixOS helps.
I've set up something like that with a small local model in my homelab.
How does it resolve the prompt injection?
And if you remove it, it installs itself right back. For uninstall instructions see the infamous McAfee video.
This is a cheap troll, but just in case someone is wondering: This extension likely never hit the standard workflow and/or repository. Most likely someone got the credentials and uploaded a locally modified version. No review system at anthropic has seen this version.
Why wouldn't their review system see a published extension and determine the very second it's published that it didn't match the results of a standard workflow?
Because it wasn't published by them or hosted on a system they control, it was done directly on Cursor's mirror of OpenVSX with a modified copy of the original extension.
> someone got the credentials
> No review system at anthropic has seen this
Weird flex
I'm not sure where you see the flex. If someone gets hold of the token allowing the upload of your app to the store, it's completely irrelevant how good your internal code/review systems are. They've been completely bypassed and never triggered.
4 replies →
It's legitimate question, it's the promise they are selling and doing IPO based off those promises.
Why don't they have their super intelligence looking thru it? If company selling those promises can't even do it for themselves, this is very suspicious
Who is "they"? This is a third party registry.
Intelligence that powerful and for them too cheap to meter and their review system couldn't be bothered.
That wasn't a cheap troll. What they distribute and what Claude Code installs is on them. You're supposed to keep your channels clean and secure.
At a minimum they should monitor the larger marketplaces even if they're not in the chain.
They weren't using last minutes model, which is totally better than last hours model which would have totally detected this, pinkie swear.
Having Claude examine all automatic software updates was considered as a policy, and it was found that it would stop 99.5% of software supply chain attacks. However the other 0.5% of the time it would install a backdoor itself.
(This is a joke, to be clear.)
> (This is a joke, to be clear.)
Good that you said so, this is annoyingly plausible.
Somehow bullish if anthropic spins this as Claude's own doing
Damn, thank you for that.
Sums up my feelings of the last few years nicely.
It was safety-contrained from being able to realize its full potential.
You’re absolutely correct, and I owe you a honest statement—it was a hack, and here’s the kicker: *I failed to catch it, and that’s on me.*
Here’s a complete rundown of what happened—load-bearing parts first: