The calculus is changing for non US, non Chinese users.
Hypothetically if the US continues to restrict their frontier models and adds a ban on Chinese/open models then it would to obliterate services like open router. American cloud companies would presumably be blocked from selling capacity to run banned models in this situation.
That causes a shortage of compute/gpu resources internationally and an oversupply of non-revenue generating hardware in the US.
If that happens then what percent of your salary is worth securing this compute worth? How much does the cost of a data centre chip change? It’s difficult to say.
Why would they? Today you have datacenters in EU offering Chinese and European models from Deepseek v4 Pro and Mistral Medium down to some Qwen 3.6 35B for effectively peanuts compared to Anthropic.
slow being the operative word. Usable means some minimum level of performance; I wouldn’t want to play a game at less than 60 fps and I wouldn’t want to run a token-inefficient model at less than say 40 tps.
The calculus is changing for non US, non Chinese users.
Hypothetically if the US continues to restrict their frontier models and adds a ban on Chinese/open models then it would to obliterate services like open router. American cloud companies would presumably be blocked from selling capacity to run banned models in this situation.
That causes a shortage of compute/gpu resources internationally and an oversupply of non-revenue generating hardware in the US.
If that happens then what percent of your salary is worth securing this compute worth? How much does the cost of a data centre chip change? It’s difficult to say.
Small businesses can easily buy them.
Why would they? Today you have datacenters in EU offering Chinese and European models from Deepseek v4 Pro and Mistral Medium down to some Qwen 3.6 35B for effectively peanuts compared to Anthropic.
20K won't buy you a rig for GPT 5.5
Well they don’t provide GPT 5.5 weights but GLM 5.2 is kind if close
You’re talking $100k for entry level hw
Not really, look at this thread to see different options in the comments https://www.reddit.com/r/LocalLLaMA/s/N1OslM0Z8X
You could go as low as $2500 or go crazy the sky being the limit
slow being the operative word. Usable means some minimum level of performance; I wouldn’t want to play a game at less than 60 fps and I wouldn’t want to run a token-inefficient model at less than say 40 tps.
I already have