Comment by botro
3 months ago
This is damn near prescient, I'm having a hard time believing it was written in 2021.
He did get this part wrong though, we ended up calling them 'Mixture of Experts' instead of 'AI bureaucracies'.
3 months ago
This is damn near prescient, I'm having a hard time believing it was written in 2021.
He did get this part wrong though, we ended up calling them 'Mixture of Experts' instead of 'AI bureaucracies'.
We were calling them 'Mixture of Experts' ~30 years before that.
https://ieeexplore.ieee.org/document/6215056
I think the bureaucracies part is referring more to Deep Research than to MoE.