Comment by interludead
2 months ago
Most people don't actually want to manage models, updates, context limits, quantization, etc. They just want the thing to work everywhere
2 months ago
Most people don't actually want to manage models, updates, context limits, quantization, etc. They just want the thing to work everywhere
Once one person figures that out and writes a blog post, everybody else can do it.
Yes, just like 90% of regular users set up NASes instead of just using Dropbox or Google Drive.
https://xkcd.com/2501/
The comparison is against your own computer, which is powerful enough, no need to add a box and set it up, and a very expensive cloud service. It’s nothing like setting up a NAS versus using iCloud (because we are talking Apple here).