Comment by hedora
15 hours ago
Nice! Your stuff ran LLMs extremely well on < $500 boxes (24-32GB ram) with iGPUS before this update.
I’m eager to try it out, especially if 16GB is viable now.
15 hours ago
Nice! Your stuff ran LLMs extremely well on < $500 boxes (24-32GB ram) with iGPUS before this update.
I’m eager to try it out, especially if 16GB is viable now.
The 5080 is 16GB VRAM, not system memory. I don't think you can get 24-32GB VRAM in a $500 box