Books in the little series are all about "learning by doing", and teach using the Socratic method (question/answer). Each concept is introduced with small problems that build upon each other. You are forced to get your hands dirty from the beginning, passive learning is not really an option. For most people, I think this helps facilitate a much deeper understanding than just reading a text.
I always had trouble with recursive functions when I was new to programming, and many recommended working through "the little schemer" to solve that problem. It was a tough read for me, but the investment was well worth it and it did for me what it said on the tin. I didn't have nearly as much trouble with recursion after that book, but an unfortunate side effect was developing an affinity for lisps which I haven't yet shaken.
Tough to answer since I've only read the two intro chapters currently available. I'm still in the early stages myself with with Deep Learning but have years of experience with programming and lisp, so I'm coming in with a background that might bias my views.
If you have never used lisp, you need to be patient with the notation and resist the urge to balk at what is unfamiliar. I remember grumbling quite a bit when I first went through TLS, but that phase was over pretty quickly and within days I had no trouble following the code.
Are there better ways to introduce deep learning and neural networks? Maybe.. but I like "little" books and there is no better way to learn something than by building it yourself. For that reason alone I'd recommend the book sight unseen (but with the knowledge of prior little books). I do think choosing what is likely an unfamiliar language for most may be somewhat of an impediment for an already challenging topic, but scheme is a simple language and allows the author to focus on the ML concepts.
I'm highly confident you'll learn a lot, if you put in the work. For DL as a separate topic, the best resources I've found are:
- 3 blue 1 brown Neural Net playlist
- Karpathy's "The spelled-out intro to neural networks and backpropagation"
I've read the Little Schemer and based on that, it has a unique style of teaching. Every new concept begins as a fun little question and through a series of more questions expands to a whole concept.
It worked very well for me in learning functional programming and some computational theory ideas.
Guy Steele's keynote talk at Dan Friedman's 60th-birthday academic festival, "Dan Friedman--Cool Ideas", gives lots of the background: https://youtu.be/IHP7P_HlcBk?t=2198 . Apparently the format was originally a parody or adaptation of that of an IBM Fortran instruction manual based on Skinnerian programmed-instruction ideas.
In particular, Scheme. If your language of choice is, say, Python, then you'll want to get a primer on Scheme before reading this particular book. Maybe by starting at the beginning of the series.
Books in the little series are all about "learning by doing", and teach using the Socratic method (question/answer). Each concept is introduced with small problems that build upon each other. You are forced to get your hands dirty from the beginning, passive learning is not really an option. For most people, I think this helps facilitate a much deeper understanding than just reading a text.
I always had trouble with recursive functions when I was new to programming, and many recommended working through "the little schemer" to solve that problem. It was a tough read for me, but the investment was well worth it and it did for me what it said on the tin. I didn't have nearly as much trouble with recursion after that book, but an unfortunate side effect was developing an affinity for lisps which I haven't yet shaken.
> "learning by doing"
Too little of that in this world nowadays. Too much ios and not enough arch linux.
ok cool! thanks for explaining. do you think a beginner in the world of AI and programming would benefit from this DL book as well?
Tough to answer since I've only read the two intro chapters currently available. I'm still in the early stages myself with with Deep Learning but have years of experience with programming and lisp, so I'm coming in with a background that might bias my views.
If you have never used lisp, you need to be patient with the notation and resist the urge to balk at what is unfamiliar. I remember grumbling quite a bit when I first went through TLS, but that phase was over pretty quickly and within days I had no trouble following the code.
Are there better ways to introduce deep learning and neural networks? Maybe.. but I like "little" books and there is no better way to learn something than by building it yourself. For that reason alone I'd recommend the book sight unseen (but with the knowledge of prior little books). I do think choosing what is likely an unfamiliar language for most may be somewhat of an impediment for an already challenging topic, but scheme is a simple language and allows the author to focus on the ML concepts.
I'm highly confident you'll learn a lot, if you put in the work. For DL as a separate topic, the best resources I've found are:
I've read the Little Schemer and based on that, it has a unique style of teaching. Every new concept begins as a fun little question and through a series of more questions expands to a whole concept.
It worked very well for me in learning functional programming and some computational theory ideas.
Worth it.
this series of books has an unusual pedagogical style, with a big "bang for the buck" in terms of building up complex systems from basic steps
there is zero fluff, almost zero narration
the books are basically just input output pairs of "now do this, and now that happens"
they are basically a sort of brain data dump for people who can think with computer code
Guy Steele's keynote talk at Dan Friedman's 60th-birthday academic festival, "Dan Friedman--Cool Ideas", gives lots of the background: https://youtu.be/IHP7P_HlcBk?t=2198 . Apparently the format was originally a parody or adaptation of that of an IBM Fortran instruction manual based on Skinnerian programmed-instruction ideas.
You can see the FORTRAN texts on Bitsavers: https://bitsavers.org/pdf/ibm/1130/lang/
> people who can think with computer code
In particular, Scheme. If your language of choice is, say, Python, then you'll want to get a primer on Scheme before reading this particular book. Maybe by starting at the beginning of the series.
It's special because it ignores the fact that the rest of the world uses Python for deep learning and it's an easy language for beginners too.
Dan Friedman and the Little X-er series.