Comment by XCSme
3 hours ago
If it's relevant to the discussion, I hope not.
I've spent probably over100 hours working on this benchmarking/site platform, and all tests are manually written. For me (and many others that reached out to me) are not useless either. I use this myself regularly when choosing and comparing new models. I honestly beleive it is providing value to the conversation.
Let me know if you know of a better platform you can use to compare models, I built this one because I didn't find any with good enough UX.
It's a great benchmark. Don't listen to the haters. This one is especially interesting.
https://aibenchy.com/compare/anthropic-claude-sonnet-4-6-med...