Comment by unleaded
18 hours ago
i'm guessing you've never seen r/LocalLLaMA?
It's a miracle that open-weight LLMs are even a thing at all, let alone as good as they are (very).
18 hours ago
i'm guessing you've never seen r/LocalLLaMA?
It's a miracle that open-weight LLMs are even a thing at all, let alone as good as they are (very).
You need thousands of dollars of hardware to run a decent coding model with bearable tokens/s.
Freedom isn't free. That is why GPL does allow charging money for software.
Freedom isn't free.