Comment by dist-epoch
5 days ago
> control over the model used
but you lose access to the most capable models, you can run only the small ones
5 days ago
> control over the model used
but you lose access to the most capable models, you can run only the small ones
Sure. I have unlimited credits for AI with my job, but I’m learning by running things locally. Start by running OpenRouter, then downloading open source tools to run locally, then modifying some python, now creating pipelines in rust. Yes, the irony is that I’m using Opus to crack these things open.
And they run slower and quantized.