Comment by Neywiny

That's what quantization and stuff is, basically. So yes. Been done for years on all neural net types not just LLMs.