Comment by SXX
3 days ago
Yeah all they care about is safety, but lets see how many of them quits once US government command them to work on autonomous killbots.
3 days ago
Yeah all they care about is safety, but lets see how many of them quits once US government command them to work on autonomous killbots.
To make sure we keep track of what we're talking about with loss-of-control x-risk, a sufficiently smart version of Claude Code is more deadly than any government's army of autonomous killbots, because it can recursively self improve and has unpredictable training-induced preferences.
Sufficiently smart version of Claude Code: dont exist.
Autonomous flying killbots: exist.
Once somebody scientifically prove and shows any kind of self-improving software we can start bothering about it. I pretty sure everyone trying to do it and it would be all over the news once its here.
That's exactly what Fable is. They use Fable to improve Fable. I reckon the successful experiments must go into the model training set with a strong RL signal, and that is why they are so paranoid about people using Fable for LLM tasks. Fable knows what it did to improve itself. Pure speculation of course.
We're on track to get there globally and economic pressures will ensure it happens. It's not too early to worry about it
4 replies →
I saw an llm bootstrapping and testing it's own harness and rewriting it's own system prompt. If that's not self improving then I dunno what is.
Can the thing enter into an runaway looop while improving the model itself -- probably not, not without us not noticing at least
That's ridiculous scifi nonsense
Dario blinked when he was asked to do it and Sam Altman was in Hegseth's DMs promising all the AI child killing the US government can order up within minutes. No one meaningful will quit over this, that's why all of the biggest US tech companies can march in pride parades and provide compute to the perpetrators of the genocide in Gaza at the same time.
Can you show me a world power that is not trying to use cutting edge AI for military purposes?
Can you tell me when the last time China used AI to bomb a school was?
Hell can you tell me when the last time China bombed a school was even without AI?
The last time China bombed anyone was in 1979.
Because other countries are starting to use AI for military purposes, other countries are also looking into it to asses and learn. Here in Europe there is the EU AI Act to limit harm everyday harm to citizens caused by AI systems. However, it currently excludes military. The new legislation is just started to be enforced to high risk uses (employment filtering, biometrics, etc.) in august 2026, and full rollout in august 2027. In April 2025 there is a report from EU this legislation may help pave the road for military AI usage conventions [1]
[1]: https://www.europarl.europa.eu/RegData/etudes/BRIE/2025/7695...
This is a poor way of framing the question, a better one would be can you find me another world power that is misallocating trillions of capital in vaporware with very little to show for it?
1 reply →