Comment by Tanjreeve

Google's infra genuinely pushed the industry forward though, things like kubernetes and SRE methodology are generally useful even if you aren't Google. Reading this I'm not even sure this sounds like the best way to run an organisation with infinite free LLM tokens let alone an actual engineering org where it just an impact on development cost. The people who are getting maximum leverage from LLM reasoning and routing queries intelligently who've made big strides in reducing inference while increasing throughout are the ones who impress me the most.