Comment by polski-g 9 hours ago Its 200-300 TPS. GPT is at 50-60. And its like 5% worse? Yeah that is a good tradeoff. 1 comment polski-g Reply verdverm 7 hours ago Are you watching/waiting on your agents? I care zero about t/sec, quality is far more important that quantity or latency, but they run in the background and I check in from time to time
verdverm 7 hours ago Are you watching/waiting on your agents? I care zero about t/sec, quality is far more important that quantity or latency, but they run in the background and I check in from time to time
Are you watching/waiting on your agents? I care zero about t/sec, quality is far more important that quantity or latency, but they run in the background and I check in from time to time