Comment by waximabbax
14 hours ago
Looks very impressive especially considering the price and speed. Let's wait for AA to confirm how well their benchmarks hold up.
14 hours ago
Looks very impressive especially considering the price and speed. Let's wait for AA to confirm how well their benchmarks hold up.
You trust AA since the sol fiasco a month or two ago?
What did I miss?
They updated their methodology when the new openai model didn't rate higher than the old one, or something like that.
1 reply →
[flagged]
Why not just try it yourself?
It costs money to run serious tests. We're way past the time when you could get an idea of the new model in a couple of tricky prompts. Now I need to compare a whole resulting project to get a clear view. If someone else proves the benchmarks don't hold up in reality, then it saves us further tests.