Comment by stri8ed
11 hours ago
Given the cost increase associated with this model, and previous model releases, I think the size is trending upwards, not down.
11 hours ago
Given the cost increase associated with this model, and previous model releases, I think the size is trending upwards, not down.
The speed says otherwise. I think they're increasing costs since they want to start seeing ROI.
Those are (mostly) new, faster TPU
latest TPU's appear to reach 800tok/s rather than the advertised 300tok/s.
2 replies →