Comment by Topfi

Hold up, 300-500tps at p50? At p99, even something like Opus 5.5 on fast reliably hits 330tps+, so that'd be expected but if truly p50, wow. And no regressions in tool call and structured output vs the official endpoint? Would love to test that with my evals, please share.