Comment by ma2rten

My personal "oh shit" moment was in 2015, when this paper came out: https://arxiv.org/abs/1506.05869

It showed me that a model trained only on movie subtitles data exhibited some (very primitive) reasoning. I have been working on Deep Learning and later LLMs ever since.