Comment by kzrdude
5 hours ago
I'm unnerved by how alphazero is more complicated than the "intelligent llms"; it has at least multiple heads and MCTS, a search algorithm. The LLMs seem to just be monolithic (if complicated) architectures where tokens go in the bottom and tokens are spit out at the top.
imagine what would happen if you gave it MCTS and the data that LLMs were trained on