Comment by jeremyjh

19 hours ago

There has always been a lot of evidence that prices are only going down. The fact that you could already get DeepSeek or GLM inference from 20+ providers on openrouter.ai was already sufficient evidence that inference was profitable and being commoditized.

People that want to believe something different as a coping mechanism will not be swayed by this evidence either.

AI will end up being a commodity. That's also why you already see the first rounds of protectionism under the guise of national security. Obviously they do have a point but that point works against them just as easily. Anybody that integrates unreviewed model output into their workflow is asking for trouble.

  • non frontier intelligence will be a commodity. Frontier intelligence will be a high margin luxury good. this is how most markets work

    • Yesterday’s frontier is today’s commodity, so I don't think frontier AI is out of reach. With computing and solar energy costs continuing to drop, the current AI supply shortages are just a temporary blip. We’ll probably land right back in standard boom-and-bust cycles.

      9 replies →

    • But it is not a constant point of "this % of people needs the frontier intelligence".

      As thje models get better, the % of the pie gets smaller and smaller. So higher and higher cost of getting frontier model out gets divided onto smaller and smaller customer base as other models catch up

      18 replies →

    • Agreed, but I I wonder what fraction of tasks really require frontier performance, either in terms of sheer difficulty or where speed is a matter of necessity. For many jobs, it's increasingly a question of whether you'd rather have one filet mignon or 20 good cheeseburgers (all from the same cow).

    • A high margin luxury good with huge r&d costs is a death spiral.

      A high per-user r&d means high costs per user. So then users leave to save a buck, qnd the price goes up again for the remaining users.

      Maybe it works out OK if you want to signal wealth - the high price is the selling point. But luxury pure utility is a hard sell to consumers, and for luxury B2B it's about high touch sales (e.g. Oracle).

    • I’m not sure if this counts as a nitpick, but the definition of frontier automatically includes the cheapest models

    • The models will be a commodity, the resources to run the frontier will be the luxury good. This is already the case nearly.

    • The market for "frontier intelligence" will be too small to serve outside of certain government/military applications that exist in spite of market forces, in the same way that the market for small, portable nuclear reactors is exclusively limited to submarines and aircraft carriers. When I call a plumber, I don't need a frontier plumber, I just need someone who's baseline competent.

      4 replies →

    • Non-frontier intelligence has become a commodity already.

      And the success of things like ESP32 shows that good price + good enough is a powerful combination.

  • > AI will end up being a commodity

    what does this even mean, the commoditization... like a thing you can buy from a gas station? AI commoditization is the rock bottoming of pricing.

    Usually we end up with cartels in such cases, see OPEC, mafias etc. But we have China throwing sticks into the wheels of the US providers that are attempting to make the cartel and "pacing the frontier"

    • > Usually we end up with cartels in such cases, see OPEC, mafias etc.

      Whether a cartel forms is independent of whether a product is a commodity. To the extent that commodity markets are more likely to form a cartel, it's only because it's harder for them to form a monopoly.

      The general problem is that if your legal system allows competitors to buy each other then they have the incentive to do that instead of competing. This is why there are supposed to be antitrust laws, and why we get problems whenever they're not actually enforced. But in a typical commodity market, even buying the competition doesn't quite work because someone new can always enter the market. Congratulations, you've cornered the market on landscaping services... until some unemployed fellow who already owns a lawnmower and a truck starts advertising their services.

      OPEC is kind of a special case because the product is entirely fungible but it's also finite and consumed by usage. Landscaping services aren't meaningfully finite, if demand increased then supply could match it under any plausible scenario. Copper is finite but it isn't destroyed by usage, so if someone had a lock on copper mining then people could still get it by recycling existing products.

      Whereas oil is finite but then the end customer burns it. If Saudi Arabia cuts production, Germany can't make up for it by extracting more domestically because they haven't got enough in the ground, but they also can't capture the exhaust from their cars or power plants and turn it back into petroleum because the product is really energy and it takes more energy to do that than you get from burning it to begin with. So if the largest exporters get together, they control enough of the market to control prices and there is no real way for anyone else to enter the market with enough production capacity to change that.

      Until you realize that the product is really energy and you can get out from under their thumb by switching to electric cars and generating electricity without burning fossil fuels.

    • China is doing all the heavy lifting for the free market in AI right now. I did not have that in my 2020s playbook.

    • > what does this even mean, the commoditization...

      Like a utility. Not 'ACME intelligence' but just 'Intelligence'. With multiple providers selling you intelligence that is 'good enough' by the token.

    • >Usually we end up with cartels in such cases, see OPEC, mafias etc.

      No we don’t. That’s quite rare.

      Look at the collapse of the solar market around 2010 as the price collapsed.

      Look at the collapse of the steel industry in the US as outsourcing to Asia took over in the 70s-80s.

      Look at the entire computing boom from 1990-2020. Memory and storage followed such a steady line down and to the right that people are struggling to operate compute businesses in a normal market.

      E-bikes, scooters, electric cars, lithium ion batteries in general. Most food.

      The list of these commoditized things that started out as areas of innovation and became just the marginal cost of production is enormous.

I’ve never heard anyone say raw inference was unprofitable. It wouldn’t even make sense, I can’t see a rug pull for renting out commodity GPUs.

People are saying _training + inference_ is unprofitable (I don’t have a dog in the race and don’t really care either way). That’s a lot of GPUs and salaries that aren’t generating revenue at any moment.

Personally, I would guess Anthropic and OAI are profitable. I just suspect that they’re a pretty normal level of profitable and not the absurd, near-alchemical “can turn dirt into gold” level of profitable their valuation seems to have priced in.

  • To add on, training + a highly paid American salary load + inference is unprofitable, if and especially if you have deepseek dropping weights and engines for anyone to run.

It's a commodity, and research into how to make it good will be done in the open. What this means is that we should doubt the justifications offered by magnificent-N-whatever companies slurping up all investment dollars to take over the world by being the first to get "general" "super" intelligence. No, there won't be a runaway improvement. Sadly, AI is just a clone of our inner world. Getting interesting information into it is still going to be just as slow as it is in the regular world. You have to build, tinker, experiment, get data, get knowledge, etc. The only thing getting sped up is how much time needs to be allocated to thinking and translating.

  • there could still be a runaway improvement, but it also almost certainly goes with the decreasing prices

    • Isn't the modern economy already a runaway improvement? First writing and agriculture, the stone age became copper became bronze became iron became steel, and one Revolution after another - agricultural 1 and 2, industrial, information.

      Looks like AI will be another revolution, and eventually, probably the largest.

There may be different thesis out there, but the fact of prices going down definitely doesn't help the case that the major AI labs are are overvalued and need to vastly increase their revenue to stay afloat amidst their contractual obligations.

I honestly don't think there are too many people arguing "AI is actually too expensive to take my job". "AI being too much of a commodity to make meaningful profits" could very well be the case though.

  • I have seen the former argued many times, though mostly not on HN. It is a cope meme I’ve seen mostly on Twitter and Bluesky, but some on HN and the Elixir forum as well.

    They are literally hoping Anthropic & OpenAI go bankrupt (totally possible), and everyone goes back to using their meat brains for work (never happening).

    In this context it just doesn’t matter if these companies are profitable after amortizing training cost, because deployment of open weight models that already exist will continue to disrupt economies for at least the next decade if all research ended tomorrow.