Comment by andriy_koval
3 hours ago
someone can run tests and see that models output exactly the same results, and then you are open to criminal investigation.
3 hours ago
someone can run tests and see that models output exactly the same results, and then you are open to criminal investigation.
On something that is inherently non-deterministic? Something which is also to a great extent distilled from other frontier models, meaning it has the possibility to generate similar outputs to those meaning that just pattern detection might also not be as effective? Easier to ban everything that’s open, than try to figure out which one of them is Chinese
Now imagine prosecutor found expert, who said there is benchmark which while performing 100k test questions found it is the same model with 98% probability, and then you need under oath testify where did you get this model.
Step 1: Chinese company publishes open weights on HF
Step 2: European company distills or just adjusts the model slightly, and publishes its model on HF
Step 3: American company uses model from step 2. Has to testify under oath where they got it from. "We got it from these French guys"
4 replies →
Many of these models will report that they are Claude. It’s going to be difficult to overcome reasonable doubt.
Models don't even agree with themselves in terms of returning identical results
Except that even the exact same model won't output the exact same results, that's a fundamental aspect of how LLMs work. They're probabilistic/stochastic, not deterministic.
Models are weights for matrix operations, they are determenistics.
They are weights for matrix operations, so in principle you'd think they would be deterministic. In practice it's more complicated than that.
Not to be snarky or dismissive, I mean this genuinely: ask an LLM about it. I currently have a headache so I'm not up to explaining the technical details, but they are interesting and worth reading about.