Comment by j45

It not only about it being an expensive setup (or not), and also other considerations:

- There's no guarantee of the $20/month service, and it likely has some limits compared to dedicated hardware token wise.

- Model are becoming more and more efficient, in many cases an M1 Max Mac Studio is still capable with 32 GB. 128 GB ram may not be the necessary baseline.

- Folks may think they want to only have a general model running locally (it's the comparable after all from the cloud providers), but we have to remember if the tasks we're trying to do ultimately are more specific than general and if there's space for the smaller models to do that.