Comment by nazgul17

Exactly this.

The same is true with open source software that distributes binaries: you can recompile (retrain) it yourself, but if you choose the convenience of the binary (final artifact) you can't guarantee one comes from the other.

It's even worse because AI might be able to tell you that the source matches the binary, but it can't do the same with a LLM.