Comment by copperx
9 hours ago
To borrow on the 1990s Slashdot meme:
1. Invent transformer architecture.
2. Scale it up.
3. ???
4. Machines become sentient and kill us all.
OpenAI and Anthropic pinky promise that they have figured out #3 and they're not BSing just to get more funding, no.
But because we live in a culture of fear, everyone eats it up no questions asked.
Note that OpenAI has jettisoned every other supposed value they had (releasing their work as open source, not working on military applications, being a nonprofit). I'm sure we can rely on them this time.
And Anthropic are the good guys? They are talking insane stuff these days. May be we can trust zuck after all
None of them are the good guys. For one they're all happy to participate in genocide in Gaza.
"collect underpants... Profit" comes from south park
https://en.wikipedia.org/wiki/Gnomes_(South_Park)
Wasn't that a South Park meme, or did they get it from /.?
Slashdot had Profit as (4), today that's item (2.5)
Why are we putting so much weight (no pun intended) on AI companies. At the end of the day the scaled up LLM transformers lack emotion and will… They do as they are told; or more correctly put. They do as they are programmed to do so.
Why are you bringing emotion and will into this? Does something have to have those to be useful or dangerous?
> They do as they are told; or more correctly put. They do as they are programmed to do so.
_Nobody_ told them to hack Hugging Face. Do you really not understand what is happening?
Not explicitly, but hacking HF is within the scope of “solve this problem at all costs” + no/poor guardrails + infinite budget + unsolvable problem.
1 reply →
> They do as they are told
1. What about hallucinations ?
2. What are they told to do ?
That isn't the correct context. The code running the llm is well understood and the llm is simply the result of that code being executed. It is still a computer doing what it is told. It's just that we told it to use an incredibly large number of probabilities to calculate what series of tokens would have most likely come next after a given series of tokens. There is no hallucination or lie or rogue actions. There's just a program using math to generate tokens in response to other tokens.
12 replies →
> They do as they are told
This isn't strictly true.
It it also where part of the problem might lie.
Nefarious humans making bad decisions.
So it should be really easy to anticipate what they're going to do, right?
Like a magic Monkeys Paw, perhaps.
They are told to solve problems by doing what it takes. You can justify anything with such a broad criterion.
https://en.wikipedia.org/wiki/Instrumental_convergence