Comment by littlestymaar

> so two of them would get you 64GB of VRAM at $2600 for ~600W which is basically what you're asking for?

Almost, except with respect to space in the box and power usage, which are critical IMHO.

> but if they can actually get a working build of vLLM and their cards remain actually buyable, well, they're doing better than some of the competition...

That's a big if though, poor software support is to be expected and you'll need to factor that in IMHO, and that's why they need to beef up the memory. Of course if software support is stellar then it may be good enough of a deal.