Comment by tigershark

5 days ago

How many humans have been born until now and how many Einsteins have been born? And in how many hundreds of thousands of years?

The point is that humans do have some edge compared to current LLMs which are essentially next token predictors. If we all start relying on current AI and stop thinking, we would only be able to "exhaust the remix space" of existing ideas but won't be able to do any paradigm jumps. Moreover, it's quite likely that current training sets are self-contradictory, containing Dutch books, carrying some innate error in them.

  • It takes a lot of intelligence to "essentially predict" next token when you're doing a math proof. Or writing code.