← Back to context Comment by samstevens 13 hours ago quantization is always a problem; what quant were you using? 2 comments samstevens Reply lubitelpospat 10 hours ago Q8_0 on my laptop, hope LiquidAI team can give some feedback on what model they offer in the playground! samstevens 9 hours ago the playground is bf16 or fp8 depending on the cloud GPU for the playground. I didn't have any issues with cows saying moo but I suspect it's just LLM non-determinism :)
lubitelpospat 10 hours ago Q8_0 on my laptop, hope LiquidAI team can give some feedback on what model they offer in the playground! samstevens 9 hours ago the playground is bf16 or fp8 depending on the cloud GPU for the playground. I didn't have any issues with cows saying moo but I suspect it's just LLM non-determinism :)
samstevens 9 hours ago the playground is bf16 or fp8 depending on the cloud GPU for the playground. I didn't have any issues with cows saying moo but I suspect it's just LLM non-determinism :)
Q8_0 on my laptop, hope LiquidAI team can give some feedback on what model they offer in the playground!
the playground is bf16 or fp8 depending on the cloud GPU for the playground. I didn't have any issues with cows saying moo but I suspect it's just LLM non-determinism :)