Comment by botro
11 days ago
This is damn near prescient, I'm having a hard time believing it was written in 2021.
He did get this part wrong though, we ended up calling them 'Mixture of Experts' instead of 'AI bureaucracies'.
11 days ago
This is damn near prescient, I'm having a hard time believing it was written in 2021.
He did get this part wrong though, we ended up calling them 'Mixture of Experts' instead of 'AI bureaucracies'.
We were calling them 'Mixture of Experts' ~30 years before that.
https://ieeexplore.ieee.org/document/6215056
I think the bureaucracies part is referring more to Deep Research than to MoE.