Comment by haris599

Can you simply ensemble the outputs of all N models for each token? I'm curious how that compares to explicitly routing each token to a different model.