Comment by delis-thumbs-7e

I gave this a run on llama.cpp locally. My GPU is Ge1080, so I needed quantized version for even such a small model and…

This. Is. Amazing. I am flabbergasted.

I am not into the whole GenAI thing and I have very little need for anything agentic, but Python, C++ and Maths is exactly what I mostly used these for, so this might actually become my main work horse. This is so cool.

I even used it for stuff it is not built for, asking complex qustion on history (Battle of Tours 732) and literature (Joyce’s Portrait of Artist) and it was surprisingly good, even though it started to hallucinate names and details (such as claiming Joyce’s father was a priest). For 3B I expected it to mainly spout complete nonsense.