Comment by ssivark
20 hours ago
Reinforcement learning can definitely (in principle) leave this envelope, but it depends crucially on whether the feedback generates new information from reality, rather than just repackaging what humans have already discovered in the form of RL environments and densified rewards. So the question is not about RL per se, but what is the information source, what is the bandwidth of information it supplies, and then only finally the effectiveness of RL in distilling information that into models.
Great point. Perhaps when we have AI robots interacting in the real world doing experiments we'll have that.
That is right now. [1]
[1] https://www.reuters.com/world/anthropic-quietly-sets-up-biol...