Comment by eleventyseven
14 hours ago
> I don't have 30k bucks to spare on a gpu :(
Do you have $2/hr to rent an RTX 6000 96GB or $5/hr for B200 180GB on the cloud?
14 hours ago
> I don't have 30k bucks to spare on a gpu :(
Do you have $2/hr to rent an RTX 6000 96GB or $5/hr for B200 180GB on the cloud?
I'd rather not give money to scalper barons if I can avoid it. Fab capacity is going to that for rental rather than hardware for humans.
I thought about that, but idk if they allow me to modify the linux kernel and nvidia cuda kernel at all
I think you can do a bunch of that on Digitalocean's GPU droplets.
In those systems you could probably leverage something like Nvidia SCADA or GDS directly.