Comment by Cookingboy
10 hours ago
2.6-pro just reached 63.7% by step 10, it's on step 11 right now.
Even flash reached 60.7% by step 12, and it's on step 16 now.
This is so exciting lmao.
10 hours ago
2.6-pro just reached 63.7% by step 10, it's on step 11 right now.
Even flash reached 60.7% by step 12, and it's on step 16 now.
This is so exciting lmao.
DeepSWE is saturated now IMO, and is basically worthless. Lots of new models get around 74%. Shame too, because it was a pretty decent benchmark for a few months there.