Comment by tomega2134
4 hours ago
"hosting GPUs for local llms" meaning pci-express bandwidth and memory bandwidth are not issues for them, and CPU features probably also don't make a difference.
4 hours ago
"hosting GPUs for local llms" meaning pci-express bandwidth and memory bandwidth are not issues for them, and CPU features probably also don't make a difference.
No comments yet
Contribute on Hacker News ↗