Comment by mmaunder

That they did not include DeepSeek 4.1 Flash on the list of benchmarks is a massive red flag for me. Anyone using open models to solve hard problems knows it’s the state of the art right now so it’s a requirement if your benchmark is sincere. This may be the start of Chinese labs taking the lead with the weakest US labs not being able to keep up.