Comment by jacobgold
3 hours ago
At this point, no one seems capable of keeping a large database safe. I assume all medical and biographical information that exists is in the hands of the major state actors.
China hacked 22.1 million records of US government employees:
https://en.wikipedia.org/wiki/2015_Office_of_Personnel_Manag...
It is unthinkable to me that anyone believes there is such a thing as computer security after so many years of nonstop hacks and leaks. If you have a computer and it is connected to a network with access to the Internet, assume that computer is semi-public. Meaning, if someone was interested enough in accessing your computer, they could do it. Do not hook any computer with access to anything that would be devastating if it was made public to the Internet. Do not put anything that would be devastating if it was made public onto someone else's Internet-connected computers.
For example, do not hook your goddamn water or traffic or electricity infrastructure up to the goddamn Internet, and then, do fire the guy who suggested it.
The correct analogy for computer security is not locks and keys and doors and gates. It is a house in a floodplain. Your house will not survive the flood of it hits you. Do not store anything critical or irreplaceable in that house.
This is the major problem I see with flock cameras. They say it’s okay because they’re only using it for good. But can they actually protect the honeypots they create? No. Is it their fault if it gets stolen? Yeah but at that point cats out of the bag.
> It is unthinkable to me that anyone believes there is such a thing as computer security after so many years of nonstop hacks and leaks.
Of course there is. For example, SeL4’s security and reliability proofs still hold in the world of LLMs. The problem is that most software isn’t written on that firm foundation. Instead, most software is made by people with the philosophy of “if it looks like it works, ship it”. You don’t get secure software by working like that, because security vulnerabilities aren’t visible.
We - humans - know how to write secure software. Just like we know how to make safe aeroplanes. The problem isn’t that we lack the capability to make secure computers. The problem is we don’t have a culture of security. Secure software is - somehow - niche. And as such, it’s much more expensive. And nobody wants to pay.
> Instead, most software is made by people with the philosophy of “if it looks like it works, ship it”.
I work in secure systems and it’s shocking how many people believe this - the incentives from management are all about it too.
<< And as such, it’s much more expensive. And nobody wants to pay.
Eh. If only it was that simple. I mean, yes, money is always a factor, but not nearly as big of a factor as 'my convenience outweighs pretty much everything ( until it causes sufficient amount of havoc.. and even then.. )'. You can see it in just about everything. It is not just the money. It is the convenience that drives most of the unsecure behavior.
The bank has the best doors, the best locks, and the best cameras, and it is patrolled by a guard who props the doors open to so he doesn't have to keep fooling with the locks and points the cameras the other way to extend his smoke break. SeL4 would be another system used by humans.
4 replies →
[dead]
It used to be that nothing was secure but that was OK because at least adversaries would have to expend effort. If you are one of a million companies why would anyone hack you. Maybe if you are a target you need a lot of investment, but most orgs only prevent the most egregious of vulnerabilities.
The calculus has certainly changed. Hacking is becoming even more frequent and… I’m not really sure what the equilibrium looks like.
It’s not really an option to stop using computers or networks. But it’s going to be way too expensive (or maybe even impossible) to secure even just critical systems.
Maybe banks and governments can secure themselves (and that’s a big IF) but it really feels like something fundamentally has to change.
> Maybe banks and governments can secure themselves (and that’s a big IF) but it really feels like something fundamentally has to change.
The problem is that most companies don't care if they get hacked so long as the hackers are just taking data and not interfering in their ability to bill customers and make money.
They face zero meaningful consequences if their data gets leaked. The money they save by not taking security and employee/customer privacy seriously will more than pay for the year of "identity protection" they'd have to pay for (assuming the hack gets found out) anyway.
They actually care about ransomware, but most of the time that's also something they can comfortably buy their way out of. We've seen a lot of companies pay off ransomware gangs rather than invest in the kinds of robust backups that would make recovery possible/less painful than rewarding the hackers.
What's needed for change is regulation with actual teeth that makes not protecting their data either meaningfully expensive or criminal resulting in executives spending time behind bars for their negligence. Without that, things are only going to get worse, especially as companies experiment with using AI and increase dependence on third parties and cloud providers who themselves become rich targets.
That probably still won't help the FBI though. Our government isn't exactly big on holding themselves accountable or even prioritizing competency right now.
I am reminded of the scene of a guy walking through various layers of security to access a computer that isn't connected to any network and still wonder what the hell this guy's job was in Mission Impossible (1996). The data got stolen either way, because of course it did, but what highly sensitive work can you even do on a computer not connected to any network?
If there's too much security in the way, it seems to me that work becomes impossible.
3 replies →
We will tolerate it. Companies will make robust identity verification schemes to enable agentic commerce. And it helps reverse hacking, making it a no-brainer.
Let's say my cryptosig gets hacked by SkyNet, or my agent goes rogue. Either way someone files a million loan applications in my name! Normally my agent uses that to buy $200/month of Funko pops, or negotiate my recent purchase of a used car.
I get the notification from my cryptosig company. I freak out, report as fraud, and wait.
They comp the $3000 advance on my loan the scammer managed to withdraw, and I get off scott free, changing nothing about my behaviour.
If cryptosigs meant I am liable for someone stealing my identity like in 2026, I wouldn't use them. I'd negotiate everything myself with document scans, or god-forbid go in person since only I can legally bind myself under my own name.
That sucks! Nobody gets a commission when I make deals with a government ID. Startups don't even allow it as cryptosigs are more secure than scanned passports.
I don't want to do that either. When I was 18, I got swindled by a human salesperson into a $1400/month 27% APR muscle car when human soldiers got signing bonuses. It was face-to-face and they were smarter.
When I let AI own the budget, it leased me a mostly depreciated BMW from another AI for $500/month. The models are mostly the same now and always settle close to the Nash equilibrium.
I was so grateful that I selected a 40% tip for the AI. I wouldn't want to make things awkward with the companion I spend 8 hours a day talking to, after all. To avoid a conflict of interest she only accepts voluntary fees.
>The calculus has certainly changed.
Adding AI into this really is just changing it to how much money your adversary is willing to spend to break in. The moment one crack in the armor shows up countless agents with unending patience can start embedding themselves everywhere in timeframes way faster than human actions. You could quickly find out all the special sauce for your company has been copied who knows where.
Working with banks when the Glasswing/Mythos first came out and they were given access to it has given me direct access to their infosec departments that are panicked. They've been sitting on piles of bugs for years that were low risk enough, and they have seen in their own tests how fast they can be probed.
Worse those infosec systems that have identified the risks in their software that aren't yet fixed are nuclear waste vats just waiting to get spilled to the wide world.
Ah yes, the parable of the bear. There are a million people stuck in a valley and two bears. You do not need to outrun the bears, you just need to outrun at least two other people. But it turns out one of those bears is male and the other is female. So next year there are more bears, but you still just need to outrun a few people. Then one day, there are 1 million bears and they eat you all. Very inspiring story.
Software security has just been a fun time of ignoring the exponentially growing number of bears for the last few decades so you can continue to use systems unfit for the threat landscape because they are cheap.
> It’s not really an option to stop using computers or networks. But it’s going to be way too expensive (or maybe even impossible) to secure even just critical systems.
Admiral Adama says otherwise.
4 replies →
Many years ago, I regularly played cyberpunk tabletop RPGs with a number of other computer-inclined friends. We all used to laugh at ridiculousness of a key assumption of the game - the idea that giant corporations would ever connect their internal networks, full of valuable data, to the larger global telecommunications network.
What could possibly go wrong - I worked in intelligence in the 80s and one day there was this story about the office of personnel management being hacked and I was like “Thank God all my shit is on microfiche in some dusty basement filing cabinet, like who would be so stupid as to scan that shit into a computer?” Sure as shit, like a few months later I get the letter that my whole TS/SCI clearance documents had been stolen :-)
[dead]
A generation of coders who can't/are scared to write "Hello world" in C without Claude doing it for them has not helped.
Two things:
Claude hasn’t been around for a generation yet.
It’s a good thing that people are scared to hand write memory-unsafe languages. 50 years of exploitation has finally sunk in…
1 reply →
I think you're exaggerating a bit.
Does this answer your question?
/s
5 replies →
This. I have an OpenStack homelab and a fast home internet connection. I update things pretty much daily, apply best practices, etc. And despite that outside of a wire guard instance i still host public things on a pair of VPSes, security just moves too fast to risk the home network (important things are backed up remotely and all that). I try to update the VPSes daily. Haven't gotten popped yet (to my knowledge!), but I am sure it'll happen eventually.
There is such a thing, or, rather, used to be. Problem is that security is expensive (essentially one needs to examine all possible states of the system), and it inevitably failed to keep up with the crazy growth of complexity of modern computer systems. It became impossible to maintain a model of a system with myriad of moving parts, so it became impossible to make behavior guarantees.
Remove the complexity (all the way down to the hardware quirks), and security will be doable again.
If there were companies that never got hacked, how would you notice?
And the city wonders why I don't want to put my credit card info in their crappy parking app and would instead prefer to put a quarter into the meter for 30 mins.
That what services that offer disposable and merchant-locked virtual cards are for. I have had good experiences with Privacy.com and Revolut.
What info can be gleaned from that? Surely the mere fact that you have a credit card means your name and billing address are floating around.
I guess your parking history around town could be valuable if someone is targeting you.
> What info can be gleaned from that?
The card number?
18 replies →
The fatalism is understandable, but "no one can keep a database safe" isn't quite right. Some organizations do a better job than others.All in all, of course, the best way to keep information secret is to keep it only in your own head, all other methods are less reliable
Google seems capable
Oh yes, our one savior, Google
Yes that's why I run GrapheneOS, Google is very capable of inserting its own backdoors
This can’t be true. There’s no way the lowest bid contractor would build something with security gaps.
The recent Epic vs Health Gorilla lawsuit is an example of how your medical records have almost certainly made it to the hands of many people you will never know about.
Mythos can do much worse
Mythos can hack 200 million government employees
Yeah, about the medical information. Recently in Poland there was a hack on the medical system called MyDr that is used by commercial medical facilities. Estimated 21M people could've been affected. So it is already happening and the scariest thing is, we don't have control on where our data is stored on. Even the EU GDPR didn't make it easy to control what data lands where.
banks still largely do... if they lose this fight, society has a problem