Comment by coffinbirth
3 hours ago
Some routing services not just route to different LLMs, they also handle all the legal issues (GDPR compliance, ISO certification, guaranteed Zero-Data-Retention, domestic data processing/European based clouds, etc.). In regulated industries, these things matter a lot, especially when processing of sensitive data is involved.
By "guaranteed" they mean "we promise really hard" right? Data retention has so much profit potential that any provider would have to be completely stupid not to retain data, even after promising they didn't.