Comment by amosjyng 11 hours ago How are you collecting your metrics on token usage and reliability? 1 comment amosjyng Reply vidarh 10 hours ago They are from my own runs, with reliability measured in terms of passing extensive test suites. So caveat is that this applies for my specific use and might well vary greatly.
vidarh 10 hours ago They are from my own runs, with reliability measured in terms of passing extensive test suites. So caveat is that this applies for my specific use and might well vary greatly.
They are from my own runs, with reliability measured in terms of passing extensive test suites. So caveat is that this applies for my specific use and might well vary greatly.