Comment by cyanydeez
4 hours ago
you mean like a Shepards Tone (https://en.wikipedia.org/wiki/Shepard_tone); i wouldn't doubt they slowly tweak quants to try to eke out.
there's also probably load balancers that downgrade models during high use.
4 hours ago
you mean like a Shepards Tone (https://en.wikipedia.org/wiki/Shepard_tone); i wouldn't doubt they slowly tweak quants to try to eke out.
there's also probably load balancers that downgrade models during high use.
No comments yet
Contribute on Hacker News ↗