← Back to context

Comment by embedding-shape

12 hours ago

Right, but aren't we jumping into trying to figure out solutions before someone actually checked if any solutions are needed in the first place?

Yeah, I think we will know more within a couple of days, once people actually download/run/test it. I'm sure the people adjacent to the 'heretic' developers will give it a test as soon as they get their hands on it. All very theoretical right now.

  • > I think we will know more within a couple of days

    It's a 3T parameters model, with a weight format (MXFP4) still not completely integrated into the ecosystem, which only a few has the hardware to even do inference with, much less fine-tuning or more post-training. But sure, do sit and wait a few days :)