Comment by jillesvangurp
6 hours ago
There are two separate issues here. One of which is very simple. That issue is where to run the models. For many companies this has to be in the EU, on EU terms. Mostly, this is not really optional from a compliance point of view. It's why all the big cloud providers have data centers in places like Frankfurt, Amsterdam, etc. and why a lot of new data centers are being built in Ireland. Of course a lot of those investments are being made by US companies. But they all have legal entities in the EU because otherwise they'd have no business here. And they can't afford to miss out on that business because it's a huge market.
The second one is about which model to run and who controls and oversees quality control. OpenAI and Anthropic seem to insist that only they can do that. But of course here in the EU we see that a bit differently. The big US based hyper-scalers are neither liked nor trusted here at this point. We don't trust the Chinese model makers much either. But with open weight models, we can at least pick different models and run them on our own terms.
Also, what most companies need is not necessarily the latest fashionable model straight from the Silicon Valley cat walk but something that will work reliably and predictably for years. Factories are not going to install the latest model in their production lines every few weeks. Same with most banks, insurers, etc. I actually know people that do business with those in relation to AI development in Germany. Companies like that are very much obsessing about self hosting their models. Sending customer data off premises is a big concern for them. They are building stuff that will be used for many years. In five years, nobody will care which model was best in autumn of 2026. But a lot of software built this year that uses AI might still be running.
You have to see Mistral's investment in that context. They could make a lot of money in the EU if they do a decent enough job. Lots of conservative companies here that are going to pick something that's good enough and then they'll be using that for many years.
"something that will work reliably and predictably for years" is not really the class of product being sold, unless you're using a fine-tuned SLM to do something like classification. The vast majority of work being done with AI unfortunately benefits from being run on the biggest/best model.