Comment by mattstir
5 hours ago
Unfortunately I don't think modern consumer CPUs are physically capable of addressing enough RAM to even load the model into memory. We'd have to wait for some random person to make an extremely quantized version before we could reach those blazing speeds
No comments yet
Contribute on Hacker News ↗