Comment by esafak

Muon is much more sophisticated than Newton's method. Neural networks have started to borrow techniques from statistical mechanics, and various branches of maths like invariant theory that were previously rarely used in engineering. CS is not dumbing down; its needs and focus are changing.

I've never needed or benefited from most of the EE curriculum. There is an opportunity cost in learning things you don't need.