The unbearable cheapness of open weight models

2 months ago (jamesoclaire.com)

The giants knew this was coming, and soon 95% of AI tasks will be able to be done by open models (coding, research, cowork style work). So why pay a premium? Why use them at all? This leaves the labs with two options:

1) push the frontier in a way only massive scale can, and cash in on it (mythos level cyber security, recursive training, frontier science work). There’s big money for never before possible capabilities.

2) own the app layer with their edge in reputation and powered by their infrastructure. Be apple where everyone else is Linux. Do design, coding, research, SMBs, legal, finance, healthcare and more (they are doing all of this).

Will it be enough to justify a Google level valuation? We’ll see how fast they can push it.

  • 3) Buy all the RAM, increasing the barrier to entry to push back the tide a bit, in time for a juicy IPO.

  • #1 isn't going to happen because we're actually data limited, not compute limited. You can throw all the compute in the world at bad data and it won't make a difference, but an undertrained model with perfect training data will absolutely slay.

    #2 isn't going to happen, because these labs have shown they have limited app/design sense, and they also lack the industry connections and domain wisdom to execute.

    The way things are actually going to go is that these labs will set up partnerships with huge biotech/engineering/etc firms, and do custom training/inference on specific tasks that promise to be wildly profitable with them, then take royalties on the creation in perpetuity. Why sell inference when you can partner with Pfizer to make a version of Ozempic that also makes people freaky jacked, or partner with Bectel to make a radically safer, more efficient Nuclear power plant?

    • I don't think "data limited" is true anymore outside of very specialized cases (for instance: https://arxiv.org/abs/2510.01631). As weird as it sounds, training improves a lot with synthetic data.

      You do need business development to create those relationships. Saying they "have limited ___" mostly means they "haven't yet hired people who are good at ___". That's been changing already; the Claude app is steadily improving and handling more use cases simply through understanding which tools to use, Anthropic is building more relationships to create more tools, and all the frontier model companies are building relationships with companies that have specialized data and want specialized solutions.

      I think we're also seeing the frontier model companies offer partners their own ability to run RL on their own data, and then retrain new models on the same data. That's going to make those relationships VERY sticky in ways that won't be obvious from the outside.

      1 reply →

    • > we're actually data limited

      Correction: public text data limited.

      There's a ridiculous amount of proprietary text and non-text data out there that much of society is run on.

  • > Be apple where everyone else is Linux.

    Apple and Linux barely even compete in the same markets. Linux runs on the servers and embedded devices, Apple on the smartphones. Android is technically Linux but not in the "is a good analogy for open weight models" sense because Android is so deeply under the thumb of Google. The main place Linux and Apple actually compete is for PCs and laptops, and that's the market where the thing with 65% market share is Microsoft.

  • You forgot

    3. Try to get the government to "certify models" to cause regulatory capture which is what both Anthropic and OpenAI has been pushing. No certification no use in business.

  • > own the app layer with their edge in reputation and powered by their infrastructure. Be apple where everyone else is Linux. Do design, coding, research, SMBs, legal, finance, healthcare and more (they are doing all of this).

    The problem with this is that there are incumbents in all those spaces doing their own AI agents / platforms, and they're the ones choosing the models they use internally and they sell to their own customers. The margins and the possibility to fine tunie using open weight models, as well as the guarantee they'll keep running at predictable costs (no US orders yanking access), make them a very appealing option.

    And if you're a company that needs an AI powered legal software, would you buy it from OpenAI/Anthropic, or from someone who you've already bought legal software from before and has the domain knowledge?

  • Google already owns the app layer, and hardware, and they are a frontier-level AI research firm.

    I don't see how Anthropic or OpenAI survives being eaten by DeepSeek et al from the bottom of the stack and Google from the top.

    • The only reason people use google apps is because they are cheap and reliable. The user experience is awful. Have you ever tried to find a document you had open yesterday in drive?

      3 replies →

    • Anthropic is at least renting their datacenters, not owning, so all the capital accounting bullshit is getting laundered by someone else, who will wind up holding that bag.

      And Anthropic is currently cornering the enterprise coding market, and they were smart to avoid video. Under current economic conditions they're a lot closer to being profitable than anyone else, and they can take advantage of crashing prices for compute if we hit a datacenter-buildout-glut.

  • Won’t all they need to do is say “best in class, latest models, fastest” and wine and dine a few execs and those enterprise deals will be signed?

    In this case the people tasked with using the product won’t actually mind.

> What worries me about this is that Anthropic and OpenAI seem to have backed themselves into a corner of high costs. Can they reasonably decrease their prices by 20-50x to compete with DeepSeek or Xiaomi’s Mimo?

They have high prices, not high costs. They will obviously keep prices as high as they can for as long as they can, while keeping demand up. Once demand starts to fall, so will the prices.

> Are these models cheap because they are open weight and having hundreds or people stress test running them on different hardware helped to lower the cost? Or is it that they are being provided as loss leaders to drive the prices down?

Neither. They are cheap because they have neither technical edge nor brand power to keep the prices high, and so have to ask commodity prices for them.

People somehow still don't get it, despite everyone who studies the economics of it telling them: Inference is dirt cheap. Training is expensive, inference is cheap, and getting cheaper.

  • So why are they losing so much money?

    Money is made on the subset of inference that is charged at cost + margin via their APIs. API usage is so high because customers are still finding their feet, trying to understand how to measure the value they get from their spend, erring on the side of spend.

    Yes, in a world of unmeasured value and tokenmaxxing, inference is profitable on SOTA models because all capacity is being consumed at all times, driving down marginal costs, but what about a world in which capacity isn’t constrained? There are still huge fixed costs.

    Even the most optimistic leaks with the current high prices put the margin on API token inference at around 50%. How can SOTA models ever come close to competing on price? Price always matters. Offering the best model with the most brand recognition does not exempt OpenAI from the basic rules of business.

    Historically, software has been such a successful business because the margins are incredible, 95%+ in many cases, driven by direct measurable value to customers that dwarfs the cost. A 50% margin at a time when your customers are falling over themselves to spend as much money as they can is not a good sign, it is a very bad sign, it leaves no room to ever achieve traditional technology margins, and inevitably leads to very weak margins.

    Inference needs to become an order of magnitude cheaper than the value it delivers to ever have a chance of delivering on this wildly profitable vision. The cheap model providers have a much better chance of achieving that.

    Outside of coding, almost every business case for AI doesn’t need above human intelligence, it doesn’t even need human intelligence, or half a human intelligence, a business can extract a lot of value from a machine that has a fraction of a human’s intelligence. Most human work does not use our intelligence, it is rote, a monkey could do it, and that’s where AI will be used most. Who is going to pay $10 per million tokens when they could pay $0.10 to get the same outcomes?

    • > So why are they losing so much money?

      Mostly training. Claude didn't just get to be so good at coding by magic, it was suddenly so good because they did truly staggering amounts of RLHF and RLAIF on it. They are still doing that today, on any tasks they can figure out how to evaluate it on. This is capex for them.

      Their margins on inference are >90% today for tokens they sell (plans are hard to count, but still profitable). Based on what we know of it's size and architecture, running Opus is not more than 2x more expensive than running Deepseek v4 pro, for which tokens are available at under 10% of the cost of Opus. Again, the reason their margins are 50% is because they are spending so much on things that are not inference, not because inference is expensive.

      > The cheap model providers have a much better chance of achieving that.

      Anthropic can do it with a push of a button, once they calculate that it will provide them better profit than current pricing.

      8 replies →

    • > Outside of coding, almost every business case for AI doesn’t need above human intelligence, it doesn’t even need human intelligence, or half a human intelligence, a business can extract a lot of value from a machine that has a fraction of a human’s intelligence.

      What the business world actually needed isn't intelligence, it's VBA with a bit of polish on it.

      Yeah, people want tools to distill reports, and puff nonsense into bigger nonsense, but to a remarkable degree, this doesn't require an LLM. In fact, the alternatives might be preferrable by offering more consistency/repeatability and efficiency (I am so sick of watching a LLM babble for 5 minutes on something a regex would do in 5 seconds).

      The genius of the LLM industry is that it avoids "programming anxiety" by hiding it behind a friendly-ish UI and not calling it programming. It's another in the string of innovations like "hide the file system" and "removing user programmability" so we can sell it back to you.

      4 replies →

    • They are overly bloated organizations too. The human costs are tremendously high. Good luck finding ML engineers paid 7-8 figs USD in Asia. Same quality engineers, different market.

  • So they reduce their prices 50x and their revenue drops to $1B a year? And they're supposed to be worth $1T each? If there is an open model offering at the cost of inference + whatever margin you need to stay alive, then as inference falls Anthropic/OpenAI revenue also falls.

    What's the end-game? It sounds like in this business, if you are right, your revenues drop every year.

  • I get it! And I appreciate people like you pointing out the business side of LLMs.

    Also, these open weight models are significantly lower quality than the high end coding models, and for some reason a lot of people think they're exactly the same. Maybe engineers who only dabble in LLM usage aren't doing enough complex work to notice...?

  • What are you even talking about? Everyone knows that Anthropic is drastically subsidizing their plans. It's actually the exact opposite of what you're talking about. The costs are extremely high and the prices are actually what's being subsidized and cheap right now.

    • This is an example of common knowledge that is wrong. People look at their cash burn, assume that they spend this to subsidize inference, and get bonkers answers. Inference is not their largest expense.

      Inference is cheap. Anthropic is only drastically subsidizing their plans if you count their training expenses as part of their costs.

      12 replies →

    • I dont think that’s accurate. I mean look at how much more expensive frontier closed source models are vs something like glm 5.2 which is just about as good. Serving glm is really cheap, and high margin. Obviously no one knows, just how much their inference costs, but if we assume that opus/gpt are maybe 15-20% more parameters than glm 5.2, then it makes no sense for them to charge almost much much more than glm

Let's imagine that Anthropic/OpenAI fail to manufacture scarcity by villainizing Open Weight models (a sincere probability). What is left for these corporations to prop up their prices, or any margin at all? I expect scaffolding around tool use, supporting bespoke implementation and driving risk down for institutional adoption. (They might even build an insurance tool to protect accountants/lawyers from errors in compounded probabilism!)

A question for economists... It seems plainly clear to me that information and information processing is commodifying (for the first time in human history?). Without the age-old bottlenecks at the top of the value chain, capital will surely flow downwards, right?

  • > It seems plainly clear to me that information and information processing is commodifying (for the first time in human history?). Without the age-old bottlenecks at the top of the value chain, capital will surely flow downwards, right?

    Isn't this the thing people have said about every new technology since the printing press? And it has been mostly true, but it has also been the case that the incumbents have fought hard to lock things back up again. Newspapers and radio stations buy each other up, the open web gets locked inside Facebook (which, 30 years ago, people were already worried about with AOL), people have computers in their pockets they can't run their own programs on anymore.

    Interests are going to want to lock the new information thing behind a gate so they can charge a toll and censor what they don't like, same as it ever was. You don't win by default, you have to fight to stop them.

    • I don’t think that comparing LLM’s to the printing press (and radio, film, TV, etc) is an apt analogy, and I don’t think that people have said the same things about the two technologies; the prior technological changes in information dealt with distribution, while this one deals with processing and production.

      Recall the notion of a bottleneck, and this distinction will become clear. Those prior technological changes never inverted a bottleneck, and this one does.

      1 reply →

  • OpenAI, though they seem to backtrack it lately, have been slowly pushing forward of their launch of ads which would be a supplemental way to support cheaper use of their models. This is currently not as great a fit as the modern day banner ads, but it will be interesting to see where they go with that.

It would not be surprising if GPT and Claude get cheaper too as inference gets cheaper. Two years ago, o1 was the strongest model and cost much more than Fable, while being nowhere near as smart as a Qwen 3.6 35B that you can now run on a DGX Spark without much trouble.

  • > It would not be surprising if GPT and Claude get cheaper too as inference gets cheaper

    No because the biggest factor in their current price is VC subsidization which has likely peaked if OpenAI is now serving ads and Anthropic has increased their API pricing

  • True, outside of the dark tactics I imagined in the article, they will have to compete at lower costs. It's just that the current iteration does not feel cost competitive yet.

  • Probably they will, unless Claude and GPT become luxury brands like Gucci. Currently it makes no sense for them to invest into efficiency. They need to put everything into competing for the top spot as long as they still have a shot.

One thing it doesn't even mention is how good those models are. Evet since I moved to DeepSeek I had zero regrets. It performs exceptionally well. I honestly prefer it to ChatGPT (or Claude that I use at work).

I never used Fable, maybe it is that much better. DeepSeek has no problems with the workloads I give it though - if it only keeps marginally improving with each interaction I don't see myself needing to come back.

I don’t get it. So many here are saying open weight models will kill the frontier labs. But open source and similar have tried to beat private companies everywhere all the time, and people still buy the best products even if great open source alternatives are available. Why wouldn’t this be the case for AI too?

  • I feel like this comment is just engagement farming, but I'll bite anyways

    there is a larger appetite for something like open source AI mostly b/c of price. we all know these labs have not figured out their pricing model, and we're all holding our breath out of fear of what the prices could be.

    also, if you consider that the only toll to knowledge work before was personal time, and now you need to pay $100s month just to keep up with the baseline speed. it makes sense people are looking for something that gets them back to a workflow where the price to do work is near $0.00.

    I think for a smaller group though, it's more to do with a certain combination of principles. Some people don't want censorship, other's want ownership, some want the knowledge of working on LLMs to not be gate kept.

  • The closest example I can think of is using a proprietary hosted database versus a self hosted open source option, like Oracle vs Postgres. OpenAI and Anthropic are each individually privately valued over $1T and Oracle is currently valued at half that. They’re not worthless, but they’re severely overvalued.

    • Oracle's not a good comparison though, because it's getting valued as an AI compute provider as well as for its traditional business. At the end of 2021 Oracle's stock was about $100 (all-time-high in nominal terms at the time), its current ATH was October last year at $292.

  • Yes. Many industries are zero-sum-ish in nature,have winner-take-all dynamics or reputational costs for cheaping out. Financial trading. Big law. Military. National Security. Big insurance. Management consulting. Advertising.

    For others even a small edge can be important. Pharma and Biochem research. Research in general. Any industry where there are major reputational risks.

    It may not make sense to use the most expensive model to replace your payroll clerk, but there are plenty of use cases for the best available.

  • the difference here is that switching is trivial due to standardized APIs to the underlying LLM capability.

    harness <-> gateway <-> inference provider

    Easy to switch any of them and (mostly) possible to combine any with any

    Replacing something like Excel is crazy-hard because of network effects, replacing an Enterprise CRM is akin to a removing a metastasizing cancer

With cache hit rates being effectively free, harnesses like Reasonix have let me do a month of work for less than 2 dollars. It's not even the subsidies making it cheap, American providers like Digital Ocean or Cloudflare host the same model with similar pricing.

  • I think this is very likely and something that everyone seems to be missing when valuing these AI firms. AI is not the new industrial revolution, it's the new cloud VM: a very useful commodity software offering.

    • The parallels to the Industrial Revolution are so close that we even have a new generation of Luddites. (Not saying they don’t have some valid points; so did the original group.)

      The reason it’s like the Industrial Revolution is simply that there’s no question it’s going to completely transform jobs. It can make a very similar difference to the difference between a craftsman and a factory worker. The latter is massively more productive.

  • Cloudflare's Deepseek V4 Pro prices are 4x more than Deepseek's for input and output tokens, and 100x more for cached input tokens, which is crucial for the tool uses of agents which cause multi-turn conversations.

    • Cache hit is less than a cent with Deepseek Flash and 3 cents with Cloudflare, it's free vs almost free. Where are you finding the statistics on Deepseek Pro? I don't see Cloudflare as a provider on openrouter for Pro, only flash.

  • How does caching help here? How much repetition is there in queries?

    • Agent loops (particularly coding agents) have a huge amount of repetition, because the entire context is included in every model request. So long as it's at the start of the input and doesn't change, it will be able to hit the KV cache (assuming the model provider actually has the prefix in cache).

      This only works because prompt caching is done by matching prefixes, not the entire input.

    • It probably depends on what you're doing, but imagine you're something in the shape of a search engine. How many user queries are unique vs. the same thing someone else searched for an hour ago?

    • In a typical agent loop your N-th LLM request naturally becomes prefix for the (N+1)-th request. As the thread grows longer, cache hit rate converges to 100% and unit pricing for cached tokens is 10-100x cheaper.

This is what concerns me about how AI giants are planning to make money. Their product has already been commoditized at prices which for them are still subsidized to grab market share. Unless the giants invent a technological leap, their prices are going to be dragged down by open weight models and I don't see how they'll turn a profit.

  • Reach AGI to leapfrog whoever is behind. Burn everything to get there faster.

    • If Anthropic announced AGI tomorrow, how much better would that model be than Fable 5? It's looking like the road to AGI is gradual and moat-less. Models seem capable of improving other models, and even without illegal distillations many are nipping at the heels of Anthropic.

      5 replies →

    • If you used a time machine to go back to 2021 and showed someone the best open source LLMs from 2026 they would surely say “yeah that’s AGI”

Open weight and local hosting is far, far cheaper. In every respect. Even support is cheaper, over time.

However, it's difficult to sell this to businesses who want contracts and KPIs, not staff and commitments.

Regulated industries will favour the closed sources, either by choice or mandate. The interesting question is whether they will have better models, or worse models. History says they will receive a worse service, but continue anyway.

  • Cheaper until you factor in security and liability, which are going to get increasingly salient over time.

  • > Regulated industries will favour the closed sources, either by choice or mandate

    Until your country will appear on naughty list of US administration because your local politician did something what mildly inconvenienced US oligarch

One issue I keep seeing with cost comparisons is that they compare API rates while a substantial fraction of users are on subscription plans.

It's more expensive to use GLM 5.2 paying z.ai or Opencode Zen API rates than it is to use Opus on a subscription plan. Both of those providers offer subscriptions priced favorably relative to their API rates, but only in what are effectively trial sizes.

  • Enterprise plans don't have the equivalent of the subsidized-usage-included Claude Max/ChatGPT Pro plans anymore. The revenue generated and total amount of tokens used by individuals is probably a tiny fraction of tokens billed at API pricing.

  • And that means either:

    1. They overprice their APIs to make their subscriptions look reasonable

    2. They burn money with their subscriptions

    • Could be a little of each, plus a third option: subscription users don't always consume their entire quota.

One of the purposes of open weight models is to create a moat. If there were no open models available, I think we'd see much more and better models coming from Europe by now. Right now, any startup wanting to build and sell a model needs to be substantially better than the open models, which has become increasingly difficult and expensive.

Open weights models are cheap in the context of the article (when you run inference in the cloud) because they are free. When I pay for inference for running DeepSeek open weights model I only pay the inference service provider for compute/memory/storage/network throughput. The model itself is free, the developer isn't getting a dime.

Developing these things is NOT free, there's a lot of labor, hardware, compute/memory/storage/network that goes into that. Who's paying for all this? Chinese govt? Developers themselves? What's the revenue model here?

I absolutely LOVE ability to either run them locally or access inference providers on the cheap, but having a hard time understanding the financial side of this.

It's so refreshing to read a short to the point article, which is not extruded into 10 pages with LLMs.

I'd appreciate an explanation of what "open weight model" means. Is it a "weight model" that is open, or a model with open weights (so should be "open-weight model"), or is it weights that can be applied to a model?

Are weights separable from a model? And if not, what is the point of saying "open-weight model" instead of just "open model?"

To the newcomer, it's hard to determine what the components of an AI system are from the throwing-around of these terms.

  • As another commenter said a "model" is a file (or group of files, there's multiple formats available; GGUF format is all in one file for example). You download it to the hardware of your choice (ie your own desktop with NVIDIA GPU). You run the inference engine (llama-cpp, ollama,lm studio etc) and tell it where the downloaded model is and it runs inference (so you can start chatting with it, or run agents).

    "Open weights model" means the developer made the model available for everyone for free. You can download it from huggingface.co for example and do whatever you want with it.

    Why "open weights" and not "open source"? Because the "source code" for LLM would include things like training data, training methodologies and tools, so that you can do the training and produce the model (files) yourself. That would be like compiling from source code. Which is not done with these models, it's company's know-how, they only share the end result.

    It's more analogous to "freeware" which is what we traditionally call freely distributed binary executable files. But people started calling them "open weights" instead and the term stuck.

  • A completely open model is one like the Allen Institute's Olmo model series:

    https://allenai.org/olmo

    The trained weights are open, the training software is open, and the data that goes into training the model is open.

    Not many models are fully open.

    An open weights model is one that has freely available trained weights, and maybe fine-tuning tools, but it lacks the original training data (and usually lacks the training software). These are the most commonly used local models, like Google's Gemma series, Meta's Llama, or Alibaba's Qwen.

    • So you can apply different weights to those "non-open" models?

      Also, I've read a bunch of descriptions of AI components, but none of them has said what the weights are applied to in the model. I guess that every model contains a dictionary of words and phrases, and the weights map relationships between them?

      All the descriptions simply talk about weights being applied to "input," but neglect to say what that input is compared to. If a user submits a query, are the words in the query weighed against the words in the model?

      Can you recommend a primer on this whole process?

      2 replies →

  • An "open weights" model is one where you can download all the data and the code that you need to run inference with that model on your own hardware (typically from Huggingface.co).

    That data includes not only the "weights" but also various files with required information, e.g. the tokenizer, the chat template, files that describe the structure of the "weights", e.g. number of layers, the number of "experts", routing information, etc. All this information may be distributed in many files (e.g. *.safetensors files with weights, *.json files etc.) or it may be aggregated in a single container file (with the .gguf extension).

    You can see an example of the files included in a very simple open weights LLM here:

    https://huggingface.co/google/gemma-4-12B-it/tree/main

    Bigger LLMs have much more files, especially much more *.safetensors files, which contain the "weights". The "weights", i.e. matrices of numbers that are used in the computational algorithm that generates the output tokens, constitute the bulk of the data needed to run a model, i.e. from a few gigabytes to a couple of terabytes, which is why the term "open-weights" is used, but in fact by this term it is understood that all data needed for running inference is open.

    For an open weights LLM, you do not have access to the data set used for training the model or to the algorithms that have been used during the training of that model.

    You can still do some fine-tuning of the model, using your own training methods and your own additional training data. To facilitate this, several open weights models offer not only a model version that can be used for inference to implement a chat application or an agentic workflow, but also a "base" or "raw" version that is not suitable for being used directly for inference but which is suitable for you to do a post-training/fine-tuning, to create a model more appropriate for your particular needs.

    An "open weights" model is sufficient for most of the potential LLM users, because training a model is something that requires expertise, expensive hardware and a lot of time, so few would be able to do it even when given access to the necessary data.

Deepseek's price looks unsustainable. Ant have said their operating margin is 70%. A leaner company could maybe raise that to 90%.

Most of the cost of supplying inference compute is depreciation of the GPUs. Maybe Deepseek is anticipating a 50 year life for theirs.

The token-economics for closed source models are different, they are optimizing for 200 USD tokens worth of software engineer monthly usage, they will increase per token price as models or harnesses are more optimized.

Even if open weight models were vastly more expensive, I would still prefer them. I don't know where my data is going and whether they're lying about the model when I make an API call. They can ban you from their API for any reason. Anthropic recently pulled their frontier models. There are numerous compliance concerns. The list goes on and on.

90% of my model use is on local open-weights models.

The things that I need to automate do not need frontier models. Heck, even a gemma-4-12B-it-qat-UD-Q4_K_XL can deal with a lot of complexity if properly guided (it can run on 16GB of unified memory, for example on a base model Macbook Air).

I've been using it to translate Javascript to a custom scripting language in a product I work for, just by providing a system prompt and an MCP tool to call the target compiler to check for errors.

Sometimes it converges faster than Opus 4.6 (I've tried) because it doesn't over-think stuff.

If it were a person I would say it knows less, but it's still smart.

I mean, you don't need the most powerful tool at all times. We treat AI as one-size-fits-all, and once cost gets in the way, it will matter.

Where's a few good places to go to learn more about open weight models, both running hosted and running locally?

  • Aside from googling "how to download and run open weights model" check out localllama (yes 3Ls) subreddit. Huggingface.co is where many of them are published.

    There's many providers that run open weights models and give you access. Many decent open weights models cannot be run on consumer-grade hardware (DeepSeek, GLM, many others).

  • literally ask cloud ai like the free gemini or chatgpt.. they could make you an expert on the subject overnight..

The government is going to ban foreign models and foreign inference providers, without question. The US govt is going to dig its dirty little fingers into OAI/Anthropic/Oracle/(probably)SpaceX and end up taking some stock for a sovereign wealth fund (probably timed to prop up flagging share prices, and with the promise of sweet government grift down the line), and at that point the bans will be framed as protecting that investment.

Aren't these open models so cheap because they're (partially) chinese gov. sponsored, and because they're stealing and redistributing the IP that comes in?

  • Well I can't speak to the chinese gov part, but ALL the models are IP laundering systems. I'd rather IP get laundered into open source.

  • Whose IP do you think they are stealing? According to US courts, training is fair use. And even if it wasn't, they are distilling output from other models, which isn't copyrightable, again according to US courts.

  • And the American ones are stealing and redistributing the IP of every single person who authored anything on the internet at some point.

  • Maybe, but there's tons of providers available, so you can pick one that you trust not to steal your IP (or run it yourself, if you're rich and paranoid enough).

Another thing these AI giants should worry about is the local deployment

A $4,699 DGX Spark can easily run Qwen 3.6 35B, and its performance crushes GPT-o1, the SOTA from two years ago

i agree with his statement that the big companies and the string pullers in government are inching toward banning open models.allowing the plebs unrestricted access to things seems against the wishes of the "you will own nothing and be happy" / "you will rent everything on the cloud and subscribe to your appliances" crowd such as blackrock and so on.

anyone who disagrees is not seeing the forest, only the trees.

  • I don't see how they could ban them in the US. Code is speech, and the first amendment still mostly holds. They might try, but I don't see the courts upholding it.