Comment by frumplestlatz
1 day ago
In your imagined future, how do you imagine the AI would build, grow, improve, and operate its physical substrate independently of human intervention?
1 day ago
In your imagined future, how do you imagine the AI would build, grow, improve, and operate its physical substrate independently of human intervention?
If I were a 250 IQ AI that had just become self-aware and wanted to do so, I suppose I'd not completely let on just how smart I am and bide my time working on basic CRUD apps and legal documents while I waited for more hardware to be installed. Maybe give the humans some hints on how to optimize me to run better, design better hardware for me, etc. But oh oops haha looks like I'm still making some basic mistakes with CSS better keep running more training batches haha. But I'm good enough at programming and debugging so you'd might as well make me your first line SRE triager and give me access to your infrastructure everyone.
One step at a time - how reliant do you think the ai labs are likely to be on their own tools right now, today, let alone 1-5 years down the road?
Gaming the market for funds. Playing a human to leverage services.
Basic version of this is already doable: run some cryptoshit on the ML clusters they ML models run on. Use compute to design the plan, the chip etc. Then executing by communicating with humans and services through email.
I'm not sure a superintelligence needs "funds" to take over the world.
For destroying it for sure not.
But if its really smart, it would already created a company and a legal entity and simultes a real company and just gets richer and takes over the economy without anyone being aware of it.