← Back to context

Comment by rayiner

8 days ago

Weights being open isn't like code being open. With code, you can inspect the code to see what it will do. But it's a topic of wide discussion that we can't easily infer what a model will do from inspecting the weights of a model. The process has emergent behaviors we can't predict.

Perhaps something like

    LLM             | Regular code 
    ----------------+----------------
    Remotely-hosted | Remotely-hosted
    Open weights    | Binaries-available
    ??              | Source-code available

  • "Open weights" is just a binary blob you are allowed to copy.

    The equivalent of a gratis non-open source app.

    Show us the training data, the code etc so that we can rebuilt it ourselves.

    • Unfortunately even if you had all that you still wouldn't be rebuilding it yourself.