Comment by eleventyseven
18 hours ago
> I don't have 30k bucks to spare on a gpu :(
Do you have $2/hr to rent an RTX 6000 96GB or $5/hr for B200 180GB on the cloud?
18 hours ago
> I don't have 30k bucks to spare on a gpu :(
Do you have $2/hr to rent an RTX 6000 96GB or $5/hr for B200 180GB on the cloud?
I thought about that, but idk if they allow me to modify the linux kernel and nvidia cuda kernel at all
I think you can do a bunch of that on Digitalocean's GPU droplets.
In those systems you could probably leverage something like Nvidia SCADA or GDS directly.
Actually since they have direct GDS it should perform really well on professional gpus
I'd rather not give money to scalper barons if I can avoid it. Fab capacity is going to that for rental rather than hardware for humans.