Comment by gopalv

1 day ago

> Does anyone think we need a Mythos level model to plan a road trip, or give someone tips on making a cake recipe?

This is starting to look at a lot like Intel vs Arm from the last era.

The Fable & Mythos are starting to look like a giant Xeon, while the smaller lighter models are starting to look like a lot of tiny ARM chips which sip on power instead.

The risk is the same as what Intel had. There is a group who are pushing them to go bigger and with a resource no limit approach, who have a lot of dollars to push you that way.

Follow them and they lead you to a pile of money, but then you risk something like Apple Silicon happening.

Something which got better because of efficiency & continuous improvement, not neutered due to it.

> The risk is the same as what Intel had. There is a group who are pushing them to go bigger and with a resource no limit approach, who have a lot of dollars to push you that way. Follow them and they lead you to a pile of money, but then you risk something like Apple Silicon happening.

The problem was that Intel stopped making things faster and better, and shifted to wearables and mobile chips instead of investing in their hard-tech strategy that had worked for decades.

Except aren’t these Chinese models having to go big too? While they might not be Mythos/Fable sized, a trillion plus parameters is hardly a local server or even desktop to mainframe style jump

  • I've had 2b models give a plausible Paris vacation itinerary. A tools-capable 12b and especially 30b model from 2026 is certainly capable of producing passable results. I was demonstrating the qwen 3.6 27b model I stood up last week to my wife and it gave her a passable Moroccan Chicken recipe. With tool calling (search) they're quite good.

    • I was on a long international flight recently with no internet and Google AI Edge Gallery installed on my phone with a 2.5GB quantized version of Gemma 4 on it. I was able to chat to it for a while and get some information about my destination which all turned out to be true and good advice.

    • With OpenAI having released 20 and 120B models a while back, I think they recognized that tiny models were never going to be a defensible income stream.

      Any value will come from the largest models, and those largest models are unlikely to ever run on consumer hardware within their window of relevancy.

      5 replies →

    • It’s AI talking about AI so cum grano salis, but my AI is saying I would need at least a half million dollar in hardware to run the newer high quality Chinese models with bemchmark-competitive force.

      You can run a Moroccan chicken fragment on the cheap in homage to what you cannot run