Comment by embedding-shape
1 hour ago
Well, GPUs are getting more VRAM, although it's pricey. But we didn't used to have 96GB VRAM GPUs at all, now they do exist :) But for the ones who can afford it, it is at least possible today. Slowly it increases.
Agreed, in the limit, RAM go up. As billg knows, 128KB definitely wasn't enough for everyone :)
I'm already thinking 96GB might not be enough, and I've only had this GPU for 6 months or so :|