Comment by altcognito

I don't think people really understand how big of a wall outside of GPU/TPUs the CPU, ram and even flash market has hit. We're paying as much if not more for the same stuff we were buying 4-5 years ago.

I do think we're more efficient and matrix operations are better (again, GPU/TPUs), but by and large, the computer hardware world has stopped exponential growth.

The period from 1990 to 2005 was amazing. Both in transistor counts and clock speed, it seemed like we were nearly *doubling* performance with every new generation. Memory and disk space had similar gains.