← Back to context

Comment by jrflo

3 hours ago

The local LLM argument never really held water tbh. You can get surprisingly good performance for lightweight tasks locally, but you're just fighting economies of scale if you're going trying to beat a datacenter on cost.

I just gave you the ROI on a retail blackwell card, the math checks out, particularly on overpriced Haiku and Sonnet, what do you mean by "you're just fighting economies of scale if you're going trying to beat a datacenter on cost" ?