Comment by arjie
4 hours ago
You're just going to have to try it. It won't take that long to quantize. Unless the server is currently serving traffic you should be able to get it going in under a day with a frontier model doing the driving for everything - quant, implementation, etc.
No comments yet
Contribute on Hacker News ↗