Comment by ux266478

The "invention" was first published in 2024, by Chinese researchers: https://arxiv.org/abs/2402.01030

Beyond that, it's a trivial batching pattern. Any remotely competent systems engineer developing an agent would immediately reach for it, it's the most basic tool in the toolbox to deal with latency. If Mistral "invested a lot of money in discovering" this, man I'm in the wrong line of work.