Comment by godbox
15 days ago
And the most reliable. A year and a half ago this was the exact reason why I switched to Gemini API from OpenAI. OAI would make me wait up to 10 minutes for the first token in the most egregious cases. Gemini served me almost immediately every time.
Huh? The constant failures in the Gemini API and overnight changes are well documented, there was a time from January to roughly July (maybe it still persists) where the API constantly spew 503 errors. This was so bad that I switched to OpenAI API instead. See e.g. https://discuss.ai.google.dev/t/frequent-503-errors-service-...
Cannot say I’ve shared that experience. Requests 504ed 5/6 times during my short trials with curl