← Back to context

Comment by matheusmoreira

3 days ago

Is there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing.

I have Claude but I don't want to ask it because Anthropic could decide to sabotage me.

4 comments

matheusmoreira

Reply
angry_octet  3 days ago

They won't be giving this away, at least not for some years. It almost certainly has distillation data embedded in it, and that would be a smoking gun.

  • matheusmoreira  3 days ago

    What? I just searched the web and the results say MiMo V2.5 Pro is fully open source. The weights seem to be out there.

    Distillation is not a problem.

    • angry_octet  3 days ago

      There are certainly open weights which are available, I don't know if that is what is running on the service.