Comment by canyon289

Its not an MOE, its what's referred to as a dense architecture, same as the Gemma3 models (But not 3n as noted)