Comment by jay_kyburz
6 days ago
Yeah, I'm ready to jump in, but I need an agent running on my hardware at home without internet access.
How far away are we from that? How many RYX 50s do I need?
This is a serious question btw.
6 days ago
Yeah, I'm ready to jump in, but I need an agent running on my hardware at home without internet access.
How far away are we from that? How many RYX 50s do I need?
This is a serious question btw.
It's unfortunate that AMD isn't in on the AI stuff, because they are releasing a 96GB card ($10k so it's pricey currently) which would drop the number you need.
I mean it depends on the model; some people running deepseek report they have better performance at home running on a CPU with lots of ram (think a few hundred gigabytes). Even when running locally vram is more relevant than the performance of the GPU. That said I'm really not the person to ask about this, as I don't have AI agents running amuck on my machine yet