Comment by PunchTornado

3 days ago

did you try to ingest 1M documents per hour with any provider except GCP with Flash? None work at scale. Deepseek, Luna, Mistral all fail. 1 in 3 requests is a fail. I stopped trying.

The only thing that works at scale is gemini flash.