← Back to context

Comment by MillionOClock

2 days ago

I was working with very small local models (<= 4B ones) in my app, there was a point where the response of the model seemed so good I really had to double check I wasn't mistakenly using a cloud model. The model hadn't made tool calls or anything, but its textual answer quality was high enough that it made me hesitate. A different kind of impressive vs the frontier models, but still was a bit of a wow moment when I remember expensive hosted models having a hard time writing proper English.