Comment by akshay_akula
5 hours ago
Open source and no markup is the right default for a gateway. The caching question above is the one I would want answered before swapping models though.
5 hours ago
Open source and no markup is the right default for a gateway. The caching question above is the one I would want answered before swapping models though.
Ans: we rarely switch, often times it's just a "switch to using this model for your agent"