Comment by jacquesm
4 days ago
There is a fair sized gap between the frontier models that you can buy access to, the ones you can run at home and whatever they've got running in house that they haven't released yet.
I am really happy with my local setup and I get a ton of mileage out of it but I'm not under the illusion that it is as good as what I could get by paying OpenAI or Anthropic. It lags the frontier by 6 to 9 months, but that's good enough for me and it makes sure that I don't had over any of my data to outsiders.
Did you read my post or are you just pumped to talk about local models?
It was you that brought up the local models. So yes, I did read your post.
The point of my comment was about how people should try really small models to see how bad they are to understand the technology better. Like 1 or 2b models.
2 replies →