← Back to context

Comment by charcircuit

2 months ago

Have you used a frontier model since 2025? You are underplaying their strength.

Kroah-Hartmann has used the closed frontier++ model, and it made up 37 out of 76 vulnerabilities.

  • And the bugs that actually were real rely on a setup so contrived it’s unlikely anyone in the world is impacted.

    It’s still good that some real bugs are being patched but what is being reported to the media is so overblown.

We've been seeing "But you're not using the latest model!" over and over again, with every new model supposedly "groundbreaking" and "a game-changer" - just for the general population to conclude a few months later that it once again doesn't live up to the crazy marketing hype.

Anthropic claimed that Mythos was so good at finding vulnerabilities that it was too dangerous to release to the public. As this post clearly shows: that (only again) simply isn't true. If you believe your favorite flavor of frontier model is the exception, it is up to you to provide proof to back up that claim.

Okay so now they're like a top percentile fresh grad on meth. Still a lack of real world experience plus some bizarre failures that illustrate gaping holes in the mental model. Does that description work for you?

  • Well, so basically supercharged fresh grad. CS/math implied.

    In human terms, that's already at least a standard deviation above average person.