← Back to context Comment by m00dy 11 hours ago The latter is a joke 1 comment m00dy Reply user43928 11 hours ago I saw that it runs GPQA Diamond and TAU-Bench Airline and shows the results over a 32 day rolling average.Other than that they track Tool call error rate and Structured output error rate.I only discovered this today, and it seems like a good idea. What are the problems in practice?
user43928 11 hours ago I saw that it runs GPQA Diamond and TAU-Bench Airline and shows the results over a 32 day rolling average.Other than that they track Tool call error rate and Structured output error rate.I only discovered this today, and it seems like a good idea. What are the problems in practice?
I saw that it runs GPQA Diamond and TAU-Bench Airline and shows the results over a 32 day rolling average.
Other than that they track Tool call error rate and Structured output error rate.
I only discovered this today, and it seems like a good idea. What are the problems in practice?