← Back to context

Comment by lukeschlather

14 days ago

Yeah, why didn't I think of just spending $30k/month on an inference server and figuring out how to train a 2T parameter model. I clearly don't care about this at all or I would just do that.

> and figuring out how to train a 2T parameter model

Why train your own model? You could use one of the many models already available on HF.

Why do you need to train a model at all?

You surely don't need frontier models for any job that isn't going to replace a human. If the human is still in the loop, just use a model the human can work with. It can be quite small. You could even be running Qwen 3.8 27B for each developer and it would be fine, and you are in control of your own destiny and can make more progressive judgements about things.

I don't really understand how the AI world has caused so much black-and-white thinking to come about. You are not under mortal threat if you don't use the latest models. This is just FUD. You still have people with brains and you might get a better result over the longer term if you use AI to assist them in their choices rather than make them sit there and hit return.

  • There are cases like this for Chinese models: https://techcrunch.com/2026/10/26/cohere-says-alibabas-qwen-...

    • Oh, for sure.

      But you can't trust any LLM, or any output from any LLM. You need to protect against stuff like this regardless. They could all do it, and quite accidentally. Even an LLM you trained yourself could do this to you, based on the training data and based on RAG.

      But if you want to avoid the specific case we are talking about where your inference provider sees everything you do, and ignores your preferences, then running someone's LLM on your own inference is the only way forward.

surely because of the speedup of AI, you don't need to figure it out, now claude can train the model for you!!!11