Comment by rohaga

Since we fan out in parallel, by definition the latency is only at worst the latency of the slowest model. The model in between is fairly light, so it seems to not materially affect things. Deciding mid-turn also lets us resolve earlier, often saving on the latency question. We hope to publish a detailed study about this soon.

We are exposing the routing decision information already, scroll over the response in the Dashboard and it'll tell you what models it considered and what it chose.