← Back to context Comment by sourcecodeplz 1 day ago $1.5kpm for SOTA. 128gb you run DSV4 Flash. 1 comment sourcecodeplz Reply pqtyw 1 day ago What's the point of running it locally though? Inference for open models is quite cheap already. They could just selfhost, anyway. The experience of running LLMs locally will be excruciatingly bad in comparison at least for the near future.
pqtyw 1 day ago What's the point of running it locally though? Inference for open models is quite cheap already. They could just selfhost, anyway. The experience of running LLMs locally will be excruciatingly bad in comparison at least for the near future.
What's the point of running it locally though? Inference for open models is quite cheap already. They could just selfhost, anyway. The experience of running LLMs locally will be excruciatingly bad in comparison at least for the near future.