Comment by a34729t
9 days ago
So basically local LLMs are rapidly improving to the point where they can handle many of the automation or local coding use cases on reasonable hardware (say $5k or less). What's the edge for frontier model providers here?
frontier models are still way better than local models from what I've seen. To get close to them with large context windows and decent performance, you need more than a reasonable machine imo.
I'm hoping local llms start rapidly improving even more though.