Comment by mike_hearn

Mistral has raised $4B+ which is a decent chunk of change, albeit not in the league of OpenAI/Anthropic/xAI.

The hard part is justifying pure LLM development financially. Models are all very similar. OpenAI justified it originally by being a 'charity' dedicated to pure research (not financial). Anthropic justified it by saying OpenAI didn't care enough about safety and splitting from them (not financial). Elon justified it by saying that AI would be woke and untruthful unless he built Grok (not financial). Google did Gemini because, well, they're where it all started and because AI research was one of the core missions Larry & Sergey gave it when they started it (but then sat on it for financial reasons).

Then there's the Chinese models. It's unclear what their motives are tbh. I've never seen a really great explanation, only hypotheses. But as they're giving them away for free or very underpriced, their motivation doesn't seem to be financial either.

But Mistral is a normal company. It doesn't have rich backers giving it money based on narratives about cosmic destiny, so it needs to justify what it's doing with ROI. So that more or less rules out large scale LLM training.

There's also EU regulation to consider. When I looked at this in the past I found lots of odd rules that kill off any chance of having a European tech industry. The UK had one that said you could only crawl the internet for research purposes!

https://knowledgerights21.org/news-story/the-uks-copyright-l...

And without the First Amendment you're at much greater risk of being prosecuted for things your models say. See how Germany has taken Google to court over things its models put in its search result pages.

So the benefit isn't clear and the legal risks are very high.