Comment by nyrikki

15 days ago

Even Russel and Norvig is still applicable for the fundamentals, and with the rise of agenic efforts would be extremely helpful.

The updates to even the Bias/Variance Dilemma (Geman 1992) are minor if you look at the original paper:

https://www.dam.brown.edu/people/documents/bias-variance.pdf

They were dealing with small datasets or infinite datasets, and double decent only really works when the patterns in your test set are similar enough to those in your training set.

While you do need to be mindful about some of the the older opinions, the fundamentals are the same.

For fine tuning or RL, the same problems with small datasets or infinite datasets, where concept classes for training data may be novel, that 1992 paper still applies and will bite you if you assume it is universally invalid.

Most of the foundational concepts are from the mid 20th century.

The availability of mass amounts of data and new discoveries have modified the assumptions and tooling way more than invalidating previous research. Skim that paper and you will see they simply dismissed the mass data and compute we have today as impractical at the time.

Find the book that works best for you, learn the concepts and build tacit experience.

Lots of efforts are trying to incorporate symbolic and other methods too.

IMHO Building breadth and depth is what will save time and help you find opportunities, knowledge of the fundamentals is critical for that.