Comment by louiereederson
15 hours ago
If open source inference engines proliferate (in terms of adoption, across models, across inference hardware) I imagine you'd get pricing pressure on that inference rev towards base card cost, so my interpretation is this is actually a bad development for compute providers.
No comments yet
Contribute on Hacker News ↗