Comment by b112
4 hours ago
Right now, all top tier LLMs are as eager, bright 20ish year old interns.
Very gung ho, full of energy, loads of book learning, no real world experience or understanding of why things are as they are.
Leave them to their own devices at your peril. Trust nothing they do.
Yet directly guide them, monitor everything they do, some value emerges.
Have you used a frontier model since 2025? You are underplaying their strength.
Kroah-Hartmann has used the closed frontier++ model, and it made up 37 out of 76 vulnerabilities.
Okay so now they're like a top percentile fresh grad on meth. Still a lack of real world experience plus some bizarre failures that illustrate gaping holes in the mental model. Does that description work for you?
Well, so basically supercharged fresh grad. CS/math implied.
In human terms, that's already at least a standard deviation above average person.