← Back to context

Comment by throwaw12

2 hours ago

> The switching costs of changing LLM providers is as low as it gets

Not trivial, you would need to do lots of evals and prompt tuning when you switch models.

imagine what happens when you optimize your agent skills to the current model, and new model starts breaking. you would need to have versioning for your skills, serving different skills based on the model while you do A/B testing