Comment by BoorishBears

5 months ago

Runpod, 2xA40.

Not sure why you think buying an entire inference server is a necessity to run these models.