Comment by srkiranraj

2 days ago

Neural network was introduced in 1950s. However, the neural architecture, the compute and data required for them to be efficient has been only in last decade.

From perceptron to transformers (few hidden layers to 480B parameters), from multicore CPUs to distributed GPUs and WWW/social media has all contributed to the growth of Artificial Intelligence.

This has took almost 50+ years and so many iterations along the way.