Comment by bluejay2387
2 hours ago
I think this should probably be scoped to 'generic router systems that don't understand query context' are not useful. We have had lots of good results with routers that understand the context of the types of workloads they process and can route requests to the most efficient models.
No comments yet
Contribute on Hacker News ↗