Comment by ceejayoz
8 hours ago
> make some of it vulnerable with a known vulnerability and Gemma will tell you
Well, yeah.
Isn't the idea finding unknown vulnerabilities?
8 hours ago
> make some of it vulnerable with a known vulnerability and Gemma will tell you
Well, yeah.
Isn't the idea finding unknown vulnerabilities?
Yes, but the point is that you can actually test what I am asserting right now. Can you use mythos and reproduce anthropics claims?
But I don't need to test that; we all know it's possible. Known vulnerabilities are in the training set!
Mythos is being claimed to have new abilities, right? What would testing the old model on a different use case do?
You’re conflating types of vulnerabilities with the vulnerability itself. Take CVE-2026-4747 which was supposedly found by mythos. The actual issue here is a stack overflow. Opus can find those.
1 reply →