Comment by verdverm

I recall reading something about it being a MoE (mixture of experts) which would align with what you are saying