Comment by cyanydeez

I'm hoping colibri can start pulling in specifically designed models for the heirarchy of decoding. It seems like we should be able to get smarter MoE models that can do the work.