Comment by winwang
21 hours ago
There's the other (orthogonal) possible explanation of using more GPUs for stress-testing before product launch.
21 hours ago
There's the other (orthogonal) possible explanation of using more GPUs for stress-testing before product launch.
That's less an orthogonal explanation and more an example of why they'd do something like serve a quantized model.