Comment by Tuna-Fish

You don't want to use a sparse model for a Taalas-like design. Something like a Qwen 3.8 27B makes much more sense.