← Back to context

Comment by NorwegianDude

1 day ago

Bigger and still worse than existing free Chinese models that are smaller? Open weight models are nice, but at this point it seems western models are very far behind Chinese ones, despite Chinese companies publishing a lot of their findings. I hope we get more open models and more providers, as being stuck with a model from China or US with no competition is risky.

Google does do a great job with Gemma models. It's one of the few language models actually good at language. OpenAI's top closed models can't even write norwegian correctly.

It takes time / few iterations to get it right (and it's moving target), but yes, expensive trial, my personal feeling is that they went a bit too high, at the same time who knows, maybe good move – as they're saying RL didn't plateau. It feels like they had something like $100M budget for it?

[flagged]

  • I hear this so much from westerners who have no connection to the people or the country. -China passed a law forbidding companies from replacing workers with AI. -China regularly punishes CEOs and corrupt government officials who do bad things. China promotes open source to the world enabling everyone in every country to have equitable access. From living in china for over 20 years and talking to many many people, the majority is happy with the trajectory of their country. Could any for these be said of the west? I won't get into specifics on which countries regularly throw bombs on children, use starvation and blockades as weapons, and completely disregard the massive dissatisfaction of their citizens...but it sure isn't china. Please clean your own house first before you complain about your neighbor.

  • This sentiment was really common circa 2005, or at least general anti-China rhetoric, where I lived in the Tri-state. Funnily enough, I have never felt more a cog, living here in the U.S., than I do right now. Maybe you are right, but my guess is wherever you live, yours is a bit of a glass house as well.

    • I am right, and whatever glass house bullshit you’re talking about is a flimsy shim of disagreement.