Comment by stanfordkid
16 hours ago
I would agree with this, except it sits on the thesis that one company really has that much of an impact. I don't think it actually does. AI is here and it will continue to progress. Norway controlling OpenAI is not going to change it's trajectory -- the cat is already out of the bag.
OpenAI may be what IBM was to PC or Motorola was to mobile phones. PC and mobile phones certainly changed the world but IBM nor Motorola controlled that change.
That's a really unfortunate framing. The cat isn't out of the bag; otherwise, there wouldn't be efforts to scale up data centers to support forecasted demand.
The inevitability narrative is a self-fulfilling prophecy, and it ends if we decide not to keep telling it.
I think you are misunderstanding the meaning of 'the cat is out of the bag', although I also think the OP misunderstands it, too.
The saying means that you can't un-tell a secret... once a secret is known to the public, you can't make it a secret again.
I think the more appropriate saying would be a similar, but slightly different, one: "That ship has already sailed"
That one is more about "it is too late to do anything about this" and less about information.
"The cat is out of the bag" doesn't mean the cat is gone, it means the cat has freedom. I read the GP as meaning "no single company can currently control the trajectory of AI." That's not unfortunate -- that's great!
No, doesn't mean that either.
People would sell piglets and would try to sell "a pig in a poke" (where a poke is a bag).
That's why you don't buy a pig in a poke because you can't see what you're buying.
Letting the cat out of the bag is because you've revealed that it was a cat rather than a piglet. You've revealed the deception.
3 replies →
With open models and the work happening outside of Anthropic and OpenAI, the cat is most definitely out of the bag.
> it ends if we decide not to keep telling it
That's wishful thinking, what are you saying, labs/people across the world will selflessly decide they're not going to pursue further research if we on HN stop saying it?
In the history of the world, one company can absolutely have world changing impact. From the British East India company to Kodak to Google, one company can have that much of an impact. Whether OpenAI is such a company is a different question for future history books to decide, but that part of their thesis at least is borne out by history.
I'm not against Norway controlling OpenAI, I think it would actually be pretty cool and prevent some of the most obvious vectors (mining personal data etc.)
I just think AI is so much bigger than one company. We already have 3 major frontier labs + Chinese labs releasing at near-frontier levels.
My thesis is that someone will solve the high inference hardware cost problem and another paradigm shift will come where AI becomes even more decentralized and democratized. Obviously that is a hunch but that is what my gut tells me.
Yudkowsky's solution of detecting and physically shutting down non complying datacenter, including bombing if the country doesn't cooperate, isn't too much out of the question.
We would have done the same if it is about virus or nuclear weapons, and AI could become serious existential threat in the next 5 years.
More or less of an existential threat than a conflict between nuclear powers because one of them decided to launch a unilateral strike against a datacentre located outside one of their cities just in case it hosted a particularly dangerous chatbot?
Trolley problem. What's worse than all of humanity dead from ASI?
Sam Altman: "Development of superhuman machine intelligence (SMI) is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (for example, an engineered virus with a long incubation period and a high mortality rate) but are unlikely to destroy every human in the universe in the way that SMI could."
1 reply →
Do you think it's possible to bomb China's AI datacenters? They are already here, and they are progressing AI at their will. What will others do about it?
It is possible for US to bomb anything. Just the retaliation could be huge.
Would you had said the same thing if a country like was developing and testing deadly virus on live population. I think in 5 years, it is possible that the AI will become that topic(if we assume AI becomes good and start hacking and controlling everything).
1 reply →