The point of my comment was about how people should try really small models to see how bad they are to understand the technology better. Like 1 or 2b models.
Of course they are going to be harmless idiots. But there is a boundary where that is no longer the case and that boundary is well within what you can run locally.
It was you that brought up the local models. So yes, I did read your post.
The point of my comment was about how people should try really small models to see how bad they are to understand the technology better. Like 1 or 2b models.
1 or 2b models are toys.
Of course they are going to be harmless idiots. But there is a boundary where that is no longer the case and that boundary is well within what you can run locally.
1 reply →