Comment by robertclaus
4 hours ago
I think fail-over for a production critical service is an equally important responsibility of the router.
4 hours ago
I think fail-over for a production critical service is an equally important responsibility of the router.
You cant fail over to a different model though. Even failing over to a different provider isn't always as simple as set it and forget it. For example bedrock doesn't support the tool search tool feature from anthropic.
They beta support for it now I believe