Comment by rinkash
2 hours ago
Does the gateway give you token accounting you can trust across providers? You mention Groq putting usage in its own field, and that’s the kind of quirk that quietly breaks cost attribution. Once you’re routing across providers, cost per request is the number most teams actually want out of a gateway, and it’s only as good as the worst provider’s usage reporting.
No comments yet
Contribute on Hacker News ↗