Comment by Wazzymandias
12 hours ago
> been trained on enough long context tasks to have become pretty good at planning
This is absolutely not true
12 hours ago
> been trained on enough long context tasks to have become pretty good at planning
This is absolutely not true
Well, they are absolutely pretty good at faking being good at long-horizon planning which is enough to fool a lot of people till things start breaking lol.
At least for my personal projects, it's enough that they're better than me at long-horizon planning.
if anything in the latest batch, they have been trained to try everything and anything to get a task done, hence their hacking abilities, but also how they go way off the rails when they don't get sufficient context on our human intent for the task
feels less like planning and more like throwing spaghetti at the wall the moment ambiguity emerges, I really hope the next batch dials it back