← Back to context

Comment by spacebanana7

1 hour ago

Local machines are a sunk cost, so using them is effectively free. Why would you pay a cloud host to run a model that can happily work on your MacBook?

1 comment

spacebanana7

Reply
TeMPOraL  8 minutes ago

If you have a machine and suddenly realize you can run LLMs on it, yes.

If you're buying a machine specifically so it's capable of running LLMs for you, then the purchase cost is your up-front payment for the inference you'll run.

And between that and electricity costs, cloud has you beat.