Comment by bee_rider
6 months ago
The models are already trained… is inference so costly? It’s just a dot product or a matvec or something, right?
6 months ago
The models are already trained… is inference so costly? It’s just a dot product or a matvec or something, right?
No comments yet
Contribute on Hacker News ↗