Comment by WithinReason
10 hours ago
> Let's also imagine for the purpose of conversation that one of the things that can be gotten at an extremely high skill level through increased intelligence is the power of persuasion.
Definitely not true as you can't use reinforcement learning to increase that capability. Only LLM capabilities that you can improve in an RL loop grow substantially.
Agreed. Like lots of this AI speculation appears to require the belief that AI will figure out how to build supervised training environments without more data.
I think this is very unlikely, but world changing if true.
Additionally, what does super intelligence even mean and why would we expect it to be obtainable from the data that we have?
I'd be delighted if someone can provide some definitions for these terms.
> Definitely not true as you can't use reinforcement learning to increase that capability.
What? Citation needed.
Well don’t you need a bunch of humans to test your persuasion capabilities? How would you run improvement tests in a loop??
You’d launch something like ChatGPT and get millions of people to use it everyday.
1 reply →