Comment by lubitelpospat
13 hours ago
Surprisingly (or maybe not?), LFM3-VL-2B gave me better results than LFM3-1.7B on text-only prompts (general knowledge, chatting) through liquid playground. As an example, when asked “what does a cow say?”, LFM3-1.7B said that a cow can say “Oink”, and when I asked the same question to LFM3-VL-3B, it (correctly) said “moo”. I assume this is lower quant problem, though: Q8 versions I’ve played with through llama both give the correct “moo” answer.
quantization is always a problem; what quant were you using?
Q8_0 on my laptop, hope LiquidAI team can give some feedback on what model they offer in the playground!
the playground is bf16 or fp8 depending on the cloud GPU for the playground. I didn't have any issues with cows saying moo but I suspect it's just LLM non-determinism :)
What do they say if you ask what cows drink? ;) Actually I’d be curious whether they would justify ‘milk’ with ‘when they’re very young’.