Comment by tomr75
6 months ago
presumably their apply model is run on their servers
I wonder how hard it would be to build a local apply model/surely that would be faster on a macbook
6 months ago
presumably their apply model is run on their servers
I wonder how hard it would be to build a local apply model/surely that would be faster on a macbook
Its hard to get a model that does it usefully on your laptop. Theres an open source 1.5B model from QuocDat, and Morph - https://morphllm.com which is a fast apply model as an API (that I run)
It’s possible, but they allow you to specify your own API (that’s how they got the prompts in this article).