Comment by embedding-shape
11 hours ago
Right, but aren't we jumping into trying to figure out solutions before someone actually checked if any solutions are needed in the first place?
11 hours ago
Right, but aren't we jumping into trying to figure out solutions before someone actually checked if any solutions are needed in the first place?
Yeah, I think we will know more within a couple of days, once people actually download/run/test it. I'm sure the people adjacent to the 'heretic' developers will give it a test as soon as they get their hands on it. All very theoretical right now.
> I think we will know more within a couple of days
It's a 3T parameters model, with a weight format (MXFP4) still not completely integrated into the ecosystem, which only a few has the hardware to even do inference with, much less fine-tuning or more post-training. But sure, do sit and wait a few days :)