Comment by Forgeties79

If 10 people are sharing it the speed advantages suddenly drop drastically. That’s $2500 a head. 5 would be $5k. Then all the rules and such you need in place

This is all this stuff that dries people to pay for frontier models. Even running modest models requires a few thousand, unless you just want really lean ones. People don’t need frontier but it’s not cheap to effectively run, say, a 16gb Qwen 3.6 or 3.8 in the 30b range. Ram is like $15/gb and GPU’s with 16gb vram are hardly cheap.