Without having looked at the text in depth, I applaud the idea here - I'm convinced the web browser can help us improve upon maths textbooks printed on paper, but there aren't many 'hypertextbooks' like this in existence (partly, I think, because most people positioned to author a maths textbook want to use latex; and most people who are able to develop a web app aren't positioned to author a maths textbook).
I'm interested to know how the authors funded this, and if they have any data about the impact it has had.
For my Linear Algebra (http://joshua.smcvt.edu/linearalgebra/), the thing that has held me back has been that the tech changes every few years. I can't keep revising something that I give away for free. In contrast, the LaTeX in which I wrote the book is 98% unchanged since the early 90's.
Perhaps this is a reason why there are some nicely designed apps with not-so-great content, and lots of books with legendary content: the whole ecosystem around app development isn't very friendly to the long-term process of writing a classic text.
It's also hard to focus on design, coding and content solo, and writing great, cohesive content tends to be a private endeavour. I'm not surprised to see immersivemath.com is written by a team.
I know (through fond memory!) your texts have some interactivity in hyperlinking to solutions and I found that very useful, but making it work must have taken time and been a bit of a headache. Extrapolate that to writing a webapp and it's easy to imagine you would never finish.
And yes, the words 'legendary' and 'classic' are direct compliments to you: your Lin Alg sits next to Spivak's Calculus on my bookshelf. They are both immortal.
Wow! Your textbook looks phenomenal. Eyeballing the table of contents and a few chapters, this arrangement of material looks exactly like what I'm advocating throughout this thread. Gaussian elimination and systems of linear equations before vector spaces, a coverage of fields in tandem with vector spaces, some treatment of sets and functions in appendices, generous usage of matrices to supplement theory...
And you include solutions for your exercises? This is fantastic! Do you have any plans to write something like this for functional analysis?
Thank you for including the solutions to the exercises. This truly is godsend. You have no idea how much it is helpful for those of who try to learn outside an educational institution.
It is very hard to feel confident in learning when I have no way to gauge if I am on the right track or not.
Solving problems like this is one of the motivators for my nascent BubbleOS project — we need a stable software base that isn't upgraded every couple of years to replace known security holes with unknown ones, also introducing unknown incompatibilities. Executable code is clearly the best representation for many kinds of knowledge, but our existing systems software isn't up to the task.
Your book taught me a lot. I got stuck some of the way in (dropped out of education at 16 - kids and full time job don't offer much opportunity for the focus it deserves). It's the furthest I've progressed with this topic and helped me understand in ways other books didn't. Thank you!
It's true that things went from embedded Java applets (or, eh, ActiveX objects, thanks Microsoft!) to embedded Flash applets to... HTML5/Canvas, but the latter does seem finally stable-ish, especially once web assembly is widespread (which it kinda is, already: https://caniuse.com/#search=wasm)
The technological endurance of LaTeX is legendary, though
Thank you for your free book.
Another great book is Gilbert Strang's book: Introduction to Linear Algebra. Also Boyle: Linear Algebra and its Applications.
Perhaps your free book can be used to develop some evolving tool for the student. For example: the student take a test and then the book select the best exercises and topics for that student.
Thank you for your book. I applaud all sorts of free texts.
I notice that there is an option to buy your book, and perhaps there are other options to somehow get money to you. I was wondering if you felt comfortable revealing approximately how much money has come to you as a result of your (donated) labours?
I'm also working on an education related project. With projects like this....the truth is, it is mostly a labor of love or passion for the subject that drives you. There isn't much money to be made (even to just support yourself) in creating free courseware. If you want to make money you are better off just working for a traditional university.
You can even see it for yourself. This guy started this project 3 years ago. Fast forward to today we can see that his youtube channel has 500 subscribers and most of his videos have around 1k views...this is after 2-3 years of each video being uploaded. Basically, no one is using this site. It is no surprise that we see so many of these education type projects being half built. The developers eventually toss in the towel.
Personally I think we need a combination of both to really change education though - open educational resources and the associated tools to learn the subject better. Preferably free but also low cost might work or supported by donations.
Right now the big publishers pretty much control the entire market. They own the content and they create the tools. Then they spoon feed it to university faculty (by making tools to basically "drag and drop" the content for teachers) and the student/taxpayers ends up footing the bill for it.
Since I create educational projects (luckily, Quantum Game with Photons http://quantumgame.io/ was partially supported by an outreach grant; all other writings and stuff - not so much), I would love to see some way to support such endeavors.
> partly, I think, because most people positioned to author a maths textbook want to use latex; and most people who are able to develop a web app aren't positioned to author a maths textbook
Luckily we have interactive notebooks (like Jupyter) and MathJax for LaTeX. You can have all the beauty of LaTeX typesetting in your browser and make it highly pedagogical with interactive computation.
+1 for Jupyter and Miniconda. I was at a Python meetup recently and one of the seminars was intro to deep learning. It is very easy to setup and quite seamless. Great learning tool as well, because you have output side by side with the teacher’s code. Many modern IDEs still struggle with this (Lighttable being a notable exception).
Most notebooks have Python code in them. How to make that interactive in browser? Are there smooth solutions out there, be it client-side or some hosted service? Or does one have to write all the code in JavaScript?
The only reason I was able to learn any math in college is because you don't need a computer to do it, so you can avoid the distractions. A browser, the source of all the distractions, seems like a really bad place to learn math.
I see your point! There is something very focused and calming about having a book open with no screens around. I hope it is possible to recreate this flow state in a browser (because I plan to try over the next few years). I'm imagining a very minimal UI, 66 characters per line typeface, a distraction free mode (full screen kiosk, a la Sublime Text), a 'dusting' of gamification maybe. I have spent hours on Project Euler before without switching tabs so I believe it's possible to focus at a computer, though I agree that a lot of the positives of the textbook experience don't easily translate; but I still believe that, with respect for the learner, their working memory and attention, a great in-browser learning experience can be achieved.
I think it's also the greatest tool for learning there is, so it's worth it to over come that tendency and develop discipline when using it for learning.
To an extent I disagree. Yes, drawing diagrams can be useful, but simply solving lots of problems is honestly the best way to learn maths. I also much prefer reading from a physical book. Im not sure simple animations will improve things massively.
I don't mind if a book skips some details and I have to fill it in myself, for example drawing a diagram to help understand a key point.
Perhaps in school most people treat maths more mechanically, and exploring requires more mathematical maturity. I don't think some basic animations will improve that directly.
That being said, people like 3b1b on YouTube are in the intersection of people who can animate and know the maths. They certainly produce things which spark the imagination.
Two of the authors, Kalle and Tomas, are at Lund University, in sort of the perfect fields for this project - Computer vision and computer graphics (Tomas wrote _the_ book on real-time rendering). I think Jacob is a graphics guy as well.
My guess on the funding is spare time and spare university resources.
>I'm convinced the web browser can help us improve upon maths textbooks printed on paper, but there aren't many 'hypertextbooks' like this in existence (partly, I think, because most people positioned to author a maths textbook want to use latex;
We have much better tools right now such as Jupyter notebook which as accessible to everyone. However, your concept of hyper textbook is intriguing.
What do you mean by that? Can a webpage be an hypertextbook? Then aren't all online books already hypertext books?
Anyways, I am working to build a different medium of learning called Primer. The courses on Primer are basically books that teaches you through conversation. It offers much more than that though. Creates latex pdf, generates flash cards , implements SRS etc.
Can you check if Primer matches your description of Hypertextbook.
I saw the word hypertextbook somewhere online once and it just stuck in my head. For me, it has come to mean a textbook (so, beautifully typeset, well organised and written, easy to tell where I am, distraction-free) enhanced with code (keep track of learning, tasteful interactives, maybe video, a smattering of ai perhaps). A webpage/app lends itself to this nicely. If I'm honest, the idea is a little inchoate but my instincts tell me there's something to it.
Primer looks like an interesting system - I'm on the mailing list, good luck!
For another great source of open source textbooks I highly recommend OpenStax (https://openstax.org/). I am currently re-learning calculus and their Calculus text is great. As an aside, I'm currently working through mathematics I wish I had taken in college (I was a biology major), starting with Calculus, and would love to connect with anyone else on a similar mathematical journey!
I've been doing Khan academy most days (like, 28 of 30) for the last year. It's been super friendly and I've moved through the algebra, geometry, trig, precalc, and differential material... I'm currently working through some integral calc stuff. I'm planning on doing the stats and linear parts of kahn before trying to take some of the online college-level courses; Sal Kahn is super great as a teacher but I am starting to feel like I can now benefit from some more difficult to digest material.
My hope is to generally increase my math abilities so I can do some electronics design classes and some study about how to start applying ML/ AI tools.
But I've found studying math to be quite fun and useful in its own right. It's fun and I feel like it's helped my general intellectual abilities.
Khan Academy is great, the only issue I have with it is it's too long-winded sometimes. Taking much longer than necessary at the cost of maintaining that comfort level of a beginner student. There is something to be said about struggling just enough according to your proficiency level (the idea of Flow in psychology).
I had a look at their pre-algebra chapter. They differentiate between "counting" number and whole numbers.
Why not use the correct terminology and call "counting" numbers "natural" numbers, it's what we've been taught in schools for tens of years, if not hundreds now.
Sure, explain that naturals are "countable" at the beginning, but this redefinition is verging on dumbing down.
edit:
reading further:
"Counting numbers are also called natural numbers."
But they seem to keep calling them "counting" numbers. Just call them their proper name and re-enforce this.
And then in this first intro... below a terrible graphic.:
"The point labeled 0 is called the origin. The points are equally spaced to the right of 0 and labeled with the counting numbers. When a number is paired with a point, it is called the coordinate of the point."
I was taught that whole numbers is a wider set of numbers than natural numbers. While "counting numbers" is a good name for natural numbers, because they are used for counting, the idea of countable set is all about our ability to count elements of this set. We can of course talk about countable set in terms of finding a bijection between the set and natural numbers, but it doesn't matter really. It is just different words to spell the same idea, while (we cannot deny it) counting elements is easier to a beginner. Maybe counting numbers is easier to grasp then natural, maybe it is just authors of textbook thinks so. I cannot understand why are you so bothered with it.
> Just call them their proper name and re-enforce this.
I'll tell you a story. When I learned math in college I was stuck by a Galois theory, I just was unable to understand it. So I decided to look different authors, to find some other approaches to explaining things. I found at least one textbook which I was forced to read from a very beginning, because it used a very different notation which I couldn't understand at all.
It was not the first time I have meet a new (for me) notations for things I already knew. I spent two more years learning math, and finally I understood one thing: there are no such a thing as "proper name" in a math. If you need to refer to a some thing, you need to define it. Math is all about your ability to name and to define things, to invent a math notation to write this things down, and to stick your mind to live inside universe which was built by your definitions, names and notations. It is doesn't matter then how original your notation is. All that matter is what results you can achieve.
From all the branches of math algebra is the most about different notations for the same thing. Just take a look at multiplicative and additive notations for groups. You can use either with any group, nothing matter just your convenience. If you like to use a plus sign and write "a+b" then use additive notation. It you prefer to use no sign and write "ab" then use multiplicative one. In algebra it is your respected right to use notation you like. But it comes with a cost: you need to respect other's right to use any notation they like.
I've been reviewing the calculus I've forgotten years ago, by taking pictures of my old Schaum's study guide with my iPad, and doing the problems while sitting on public transportation.
I find the badly kerned math typography of the Open Stax offering, and the PDF version of the modern Schaum's study guide, to be distractingly jarring.
This seems like one of the best uses of computers for educational media, one of the ways digital instruction can really shine through compared to physical text which can often require supplemental videos or help from a teacher to elucidate a concept.
Feels very reminiscent to me of 3B1B videos [1] on topics that use visuals to elucidate math topics more clearly as well.
In case anyone is interested in a written version of some of the essential points 3Blue1Brown makes, I recently released my own review notes which try to provide a brief overview of some of the main linear algebra topics as well as applications: https://github.com/photonlines/Intuitive-Overview-of-Linear-...
3Blue1Brown's Essence of linear algebra series is the go to place for learning this material. I've included the link to the series below so people don't get lost in all his other wonderful videos along the way.
Upvoting this because I think it's really important that we start getting more open source textbooks which specialize in exposition[1]. That being said, I'd make a different arrangement of the material.
Here are a few thoughts:
1. This book embraces the modern take on a rigorous course in linear algebra, which I disagree with. That is to say, it covers vector spaces front and center in the first chapter. Conversely, systems of linear equations (Gaussian elimination) and corresponding notions like row reduction of coefficient/augmented matrices are pushed back several chapters. You see this in popular "flagship" textbooks like Axler's Linear Algebra Done Right because they're prioritizing the underlying theory. I think Gaussian elimination should be covered first because it motivates the material - you're never going to cover Linear Algebra in a way that makes all the pieces fall together in a purely straightforward dependency.
But if you first cover systems of linear equations, you actually motivate the purpose of vector spaces. Moreover, many (most?) proof-based problems in linear algebra reduce to solving a system of linear equations (and therefore reducing a matrix) which is modeled after the thing you're trying to prove. What's the basis of a null space of this linear transformation? You can solve it with row reduction. Is this spanning set a basis of this vector space? Solvable through row reduction. You get a lot of equipment for solving vector space problems if you build up the row reduction scaffolding to a minimal level before vector space coverage. This does not have to temper the theoretical rigor of later, abstract material; if anything it grounds and augments it.
This is why I'm a huge fan of the way that Hoffman & Kunze cover this material. That is a heavily theoretical book, which easily surpasses undergrad-level linear algebra in later chapters. A couple of decades ago it had the spotlight as the really good linear algebra book (it displaced Halmos' Finite Dimensional Vector Spaces, and was itself displaced by Friedberg or Axler). But it motivates a very rigorous coverage of vector spaces by starting with Gaussian elimination, matrix representation of systems of linear equations and (reduced) row echelon forms. If you don't cover this first, you have to either assume the student knows it already or you resign yourself to wading through several chapters of potentially unmotivated abstraction.
2. In my opinion, linear maps should be covered directly after vector spaces. They're a logical succession of the same concept - after you've taught linear combinations, linear (in)dependence, spanning sets, bases, subspaces, and related theorems, it's very easy to jump right into functions between vector spaces. It's just an expansion on all of these things. I would therefore rather see chapter 9 immediately following chapter 2. And much like my prior point, linear maps are an abstraction that empowers a lot of the other ideas; this is mainly because so many things are representable as a linear transformation (much like they're representable as a matrix).
3. The rank is a very important concept, but I would argue it should be subsumed into the chapter on matrices. You can cover anything that doesn't fit cleanly in the matrices chapter in the chapter on linear maps, since you'll need to do that anyway before you cover the dimension theorem. That might be a good argument for simply covering matrix multiplication and addition in prerequisite material and subsuming all of matrices under Gaussian elimination and/or linear maps too...
4. I'm a big fan of the prerequisite material covering basic trigonometry. Trigonometric functions are a good source of exercises for vector spaces. I would like to see an expansion which does minimal coverage of naive set theory (sets, subsets, unions/intersections, etc), functions (injection, surjection, bijection) and polynomials. If you cover the basic definition and arithmetic of polynomials here, you save yourself some space when you cover Lagrange interpolation and factorization later on. It's probably a lot to ask for, but some coverage of differentiation of polynomials would also be useful because the theory of vector spaces gets a lot richer when you incorporate exercises which use a bit of calculus/analysis. In particular, using vector spaces of functions and linear maps of differentiation give you a lot of leeway to show how abstract vector spaces can be without going nuts on the moon math.
5. I've received pushback on this before, but I think it's really important to cover fields as their own subject before covering vector spaces. If you're going to cover vector spaces rigorously, you really need to cover the field axioms. Scalar multiplication doesn't make sense without first defining a field (you can handwave it, but it's easy to make subtle mistakes - like missing that the set of all integer $n$-tuples cannot comprise a vector space). Likewise you ordinarily need your linear map to agree on a field to be well-defined. This coverage would ideally also establish the basic facts of the real and complex fields, which are almost entirely the fields you work with in undergrad linear algebra.
6. I don't see any exercises. A good math textbook challenges its reader to internalize each chapter's material by substantially using it to prove further material. By not including exercises, this text becomes more of an illustrated monograph. That's totally fine if it's what they're going for, but I think there's a huge opportunity to tailor it even further with targeted exercises that expand on the theorems in each chapter.
Note that I'm mostly nitpicking here, even if I think my critiques have merit. The exposition of material is much more important than the arrangement of material, as long as things are building on each other rigorously. I'm not trying to say the textbook is bad; this is just a stream of consciousness about my opinions on arranging linear algebra for maximal pedagogy. You generally have to supplement textbooks in order to get a rich understanding of the subject matter anyway.
On the plus side, I'm a huge fan of the way they present vectors geometrically. That's a huge win for illustration/animation purposes. I do think there's a missed opportunity to make a sexy illustration of transforming a system of linear equations into coefficient, unknown and constant matrices; then from there illustrating the transformation of the augmented matrix into its reduced row echelon form.
I like this idea. It's also how the subject developed historically. That said, don't you get a very computational book in which students spend a lot of time working with matrices filled with numbers if you teach Gaussian elimination first? How do you make sure that students understand the big picture? After all, modern linear algebra is a lot more than the Gaussian elimination algorithm. I'd even go so far as to say that if a student don't understand Gaussian elimination but understands everything else and that there exists some algorithm to solve linear equations, they'd still get 95% of the value of a linear algebra course.
Maybe you can do that if you make it very visual like the book linked in this post, so that you bring in the geometric concept of a vector and link it to linear equations, rather than only working with tuples of numbers. For example, linking the visual concept of linear independence of a set of vectors to a system of equations having a unique solution. If you do that you may be able to teach linear algebra from a linear equation solving point of view, while not getting bogged down in manipulating matrices of numbers.
> After all, modern linear algebra is a lot more than the Gaussian elimination algorithm
This is kind of my point - there actually isn't a whole lot more than Gaussian elimination at the core of linear algebra until you get to rings and modules. Of course I don't mean that in the sense that there aren't important definitions or topics. The theory is very rich. What I mean is that most theoretical questions you can ask about vector spaces and linear maps (or more abstractly, the linearity of a thing), are reducible to a matrix representation and Gaussian elimination.
You don't have to use Gaussian elimination, and I'm not arguing the course should become rote computation of matrices. There is a middle ground. For example if I hand you a linear map and ask you about the dimension of its range, you can identify a spanning set, refine that to a basis and you have your answer. You could also just take the rank of the matrix representing that linear map reduced to row echelon form. I don't think you lose much theory one way or the other.
But I could be wrong - if you have a specific example I'd be interested in hearing it. I've tried to declare front and center that I'm biased from learning linear algebra through Hoffman & Kunze. Halmos also grounded his (very theoretical) book in a generous use of matrices. Not covering matrices until later is a fairly recent development, and I think it's because (for reasons I've stated elsewhere) many professors don't distinguish between the rote computation of matrices and the rich theory of matrices.
Apart from Gauss elimination, I think eigenvalues, eigenvectors, scalar product, orthogonal subspaces, and the relation to statistics are important. Statistics associated with SVD, principal components and other topics are a main source of insights. Also Fourier basis is an important concept far beyond Gauss elimination.
Of course, I'd agree. But my comment is pretty long as it is, and is more concerned with the arrangement of material than how many extended topics you cover. I'm treating perfection as nothing left to remove, not nothing left to add :)
This is interesting, but I think there's an implicit assumption here that a particular topic must be covered in depth, at which point its study is completed, not to be returned to.
And indeed, this is way many textbooks are structured. But I see no reason for this to be the case. If topics are covered lightly via an exposition and then subsequently drilled into in depth, the order, and resulting motivation becomes almost a side note.
I say this as I'm currently studying linear algebra via Coursera, and the resource that has become most valuable to me is a Scapple board with a bunch of screenshots, text and arrows. It is this (non-linear) diagram that I return to most often to help internalize and solidify my learning.
In this regard, the order of exposition becomes almost incidental.
I think the problem is a tension between what’s valuable to us in learning and what's valuable to us after learning.
So when I was tutoring, I noticed that my “standard approach” failed: a kid would have a homework problem, I would say, “Here's how you want to think about that problem, it’s (say) a conservation of energy problem, calculate the energy before and after...” and it fostered no real learning! I thought the problem was that I was subsidizing laziness—stepped back a bit but gave lessons after some struggling—and that didn’t hurt much but it didn’t help much either. They were motivated, just the didactic structure was not working for them. I started to ask questions, and that was a bit more helpful, but found that I myself was somewhat unguided about how to accomplish “Socratic teaching” so that they could benefit from it—if you can believe it, my default approach was to try to introduce the same theory ideas as questions from the start, “would conservation of energy apply here?”—so no wonder I only got mixed results: it was basically the same thing.
But questions gave me a way to get off that map, because I started to ask tutees to give me expectations and examples, and somehow those worked well. “What can we expect that this system does, within a few orders of magnitude? Can you give me some examples of similar systems and how they work?”
I think that in order to learn abstract things, we need to first have a bunch of examples in our heads, things that all kind of fit together but do not make sense. The abstraction unifies the examples, helps us remember them and fit them together. We can use each example to test the abstraction for fit, to massage our cognitive ability from one context into another.
When we build a building, we need frameworks and scaffolds to build it. When the building is freestanding, all of that effort of building the scaffolds can be undone, the scaffolding comes down, it's no longer necessary. We go back to a textbook and we want a picture-book: show me the building, and just the building, and nothing but the building. Let me feel lushly indulged by its architecture, by photographs that go into detail in the really rich areas—I want indulgent artistic experience, because that's what the building is!
We have a constant tension in textbooks between the how-to-manual—spartan, practical, containing all of these scaffolding steps and nitty-gritty–and the coffeetable book—rich, whimsical, pop-simplified.
Griffiths’ Introduction to Quantum Mechanics begins with a prologue to this effect, though I thought it was just a quantum quirk at the time I think it's actually much more general now. He says [these will not be exact quotes] that, “This book will teach you to do quantum mechanics because I strongly believe that this has to come before any sort of strange discussions about what quantum mechanics is.” It’s one step between Feynman’s “don’t even try to understand quantum mechanics, just shut up and calculate” and Searle’s response “I’m sorry, I am a philosopher and literally the only thing anyone pays me for is to try and understand things like quantum mechanics.”
And I think that is where I want to focus my teaching efforts, that every textbook should kind of have the appendix coffee-table section, I’d even like to carve out a new name for it and call it an “abridgement” or so, at the end. The book Mazes for Programmers has an appendix like this of “let me summarize all of these maze generation algorithms and their essential properties and their essential approaches” that I really loved, it makes it an absolute joy to keep this thing on the bookshelf and come back to it time and time again. The main text has the “Here’s how to do it” information, the appendix has the polite overview of what was just built that is great for returning to.
Yes, I think you've captured the problem pretty nicely. This is the problem I have with doing something like defining vector spaces on arbitrary fields F (not even R or C!) before you even talk about linear equations. The theory of linear algebra is rich and useful, but it's hard to motivate it that way. I don't mean "motivate" in the sense of, "Why should I care about this, and when will I use it?", because you don't always need that kind of motivation to do math. I mean motivation in the sense of, "Why did people come up with this theory? What led them to these definitions, and why are these definitions the right ones?"
I have seen the hierarchy of math presented like this:
1. In high school, you're taught how to compute arc length. You need to do nothing but calculation, and it doesn't matter why it works.
2. In undergrad, you're taught to prove the formula for computing arc length. Given the theorem statement and the requisite axioms, you can show that the formula works.
3. In grad school, you're taught to derive the formula for arc length from first principles. Given a set of axioms, you come up with the theorem and prove it from scratch.
4. In research, you're not taught anything. Instead you solve the questions, "How should I define arc length? Why does my definition of arc length matter, and where is it useful? What can I prove with it?"
Contrary to (quite a bit of) popular opinion, I would hold that a truly rich understanding of the theory can only happen in the context of the trigger for the theory. You don't need to understand the context of systems of linear equations, or why linearity is a useful concept, to understand vector spaces. But it's a lot easier if you have that context. Likewise you don't need to use Gaussian elimination to solve a lot of questions which ask you to prove something about a vector space or a linear map. But if you have that context, you can use it in your proofs instead of miring in towering heights of complexity.
Incoming tech seems about to change the texts-and-tutoring constraint and opportunity space. I wonder if it's time to start thinking and exploring ahead?
Consider an art project, where you sit in a booth, and watch an interesting video drama. But why is it interesting? The video is a graph of segments, like an old "choose your own adventure" story. And there's an eye tracker watching you. So if you're interested in characters A and B, the story mutates to emphasize them.
Consider a one-on-one tutor on a good day. Noticing a student engaged and enthused, they might reorder content on the fly to leverage that. Might emphasize different aspects, and alter presentation, based on observed interests and weaknesses. Or consider working with a young child, watching them read word by word, noticing their where they hesitate and frown, probing for their thoughts, adjusting difficulty, providing a path of development.
What if that was math content rather than a drama or children's book? What if we could do this at scale? Eye tracking is just one tech coming in on the coattails of VR/AR. A setting for personalization AI is another.
What if saying "the best way to organize and present this topic in a textbook", becomes like saying "the Capital mandates, that every teacher of this grade, will today all teach the following lesson, by saying the following words, regardless of local context"? While not on a national level, that is a real thing.
What might it take to start encoding an adventure graph for linear algebra? The "oh, if you like this perspective on this topic, you might like this similar perspective on this other topic"?
Or if we don't have the tooling for that yet, can we start thinking about the tooling? Or fruitfully do something else now, in preparation for opportunity? Perhaps Kahn academy problems in more flavors, in a richer graph? ML-based textbook aggregation, synthesis and retheming? Perhaps it's all not ripe yet. But something else, maybe?
If you read the older editions of physics (and my comment applies to physics, not math) textbooks like Lanczos and Kittel (let’s leave Landau out of this) where the examples and problems are interspersed in the text often with solutions, the clear implicit invitation is to the students to come up with their own problems (ideally paradoxes!). This is related to point 4 in throwawaymath’s comment: https://news.ycombinator.com/item?id=19265709
If you don’t expect them to be potential future faculty, then by all means let other people hand you the problems and paradoxes unless you’re in contact with experiment.
This. It’s a daily trade-off, as a working professional, between how deep I should learn the fundamentals and how quickly can I get to solving problem at hand.
As an example, I want to learn how to deploy my models on the cloud but the mechanics of how computing on the cloud works is a depth trade-off. I wish I could learn all about distributed computing concepts but I find that I have neither the time or energy for it, at times.
And Searle is an interesting argument for Griffith's perpsective. Searle rose to fame talking about stuff he knew how to do ("speech acts") and in his later years embarassed himself with bad criticisms of AI, as in the Chinese Room, his garbled continuation of the fallacy of the Philosophical Zombie.
Because in fairness, it does do so many things right. It's kind of controversial[1] because of Axler's notation and de-emphasis on determinants. But it's an ideal book to give a student who has had a first, computational course in linear algebra (i.e. a course entirely devoted to solving systems of linear equations and drilling matrices).
I think Hoffman & Kunze is really the best textbook for the arrangement of material I'm talking about, but it's outdated at this point and its exposition is strictly less pedagogical than Axler. My vision for the "perfect" linear algebra textbook would be loosely based on Hoffman & Kunze, but replacing a lot of the theoretical exposition with Axler's exposition from Linear Algebra Done Right, then keeping (and even expanding) the mterial on Gaussian elimination and matrices. You could get a solid three-semester sequence of computational and proof-based linear algebra out of such a textbook, and you'd be all set to go to something grad-level like Roman.
Unfortunately it's also hard to judge a lot of linear algebra textbooks because the bifurcation between proof-based and computation-based linear algebra isn't as clean as it is in calculus. Calculus has its own separate course sequence in real/complex analysis, whereas linear algebra doesn't have a distinct name for the more rigorous coverage of the subject. So you have a lot of textbooks which choose one or the other thing, which then results in an over-emphasis on computational stuff in the first course and a complete de-emphasis on the motivation in the second course. When you are learning these back to back in distinct courses that's usually fine, but many first courses actually jump right to Axler despite the words of caution he writes in his own preface.
have you looked at "Matrix Analysis and Applied Linear Algebra" by Carl Meyer? it seems very in line with what you're saying and the exercises are absolutely excellent. I've slowly made my way half way through the book and am very happy over all
Why is that? Note that when I mention the dimension theorem, I'm actually referring to the fundamental rank-nullity theorem.
To be more clear, what I was suggesting is to take the section on rank, toss that into the section on matrices, and then toss that into the section on Gaussian elimination (preceding vector spaces). That's useful because the rank of a coefficient matrix tells you the nature of the solution space of the corresponding system.
Then when you cover the rank-nullity theorem in the chapter on linear maps, you'll have the context of 1) what rank means in a matrix, and 2) what rank means in a linear map. That sets up a deeper understanding of how to verify the rank-nullity theorem for any linear map by finding the rank and the nullity using the basic and free variables of the reduced row echelon matrix.
I thought matrices were pretty cool when I took Linear Algebra in college. However, I hated doing the computations by hand; it makes one really appreciate computers.
This reminds me of the mobile game Euclidea, which is a puzzle game where one must build geometric figures with as few operations/tools as possible:
https://www.euclidea.xyz/
This is fantastic! I'm planning on taking linear algebra in the fall and a glance over this makes me think it will save me tons of time searching youtube and etc for explanations of trickier concepts.
20 years ago, when web browsing was still newish, I would have expected HUNDREDS of interactive-learning sites like this to have been set up by now. I am very glad to see this!
I really like the concept...but where do people pronounce algebra that way? It sounds like a computer trying to sound normal (to my ear. I'm more of a Al-Ja-bra kind of guy, not Al-Ga-bra)
Try http://abstract.ups.edu/aata/. I have no affiliation with the authors, but I think it's really quite good. Symmetries in particular have a lot of illustration.
Without having looked at the text in depth, I applaud the idea here - I'm convinced the web browser can help us improve upon maths textbooks printed on paper, but there aren't many 'hypertextbooks' like this in existence (partly, I think, because most people positioned to author a maths textbook want to use latex; and most people who are able to develop a web app aren't positioned to author a maths textbook).
I'm interested to know how the authors funded this, and if they have any data about the impact it has had.
For my Linear Algebra (http://joshua.smcvt.edu/linearalgebra/), the thing that has held me back has been that the tech changes every few years. I can't keep revising something that I give away for free. In contrast, the LaTeX in which I wrote the book is 98% unchanged since the early 90's.
Perhaps the tech is settling down, I'm not sure.
Perhaps this is a reason why there are some nicely designed apps with not-so-great content, and lots of books with legendary content: the whole ecosystem around app development isn't very friendly to the long-term process of writing a classic text.
It's also hard to focus on design, coding and content solo, and writing great, cohesive content tends to be a private endeavour. I'm not surprised to see immersivemath.com is written by a team.
I know (through fond memory!) your texts have some interactivity in hyperlinking to solutions and I found that very useful, but making it work must have taken time and been a bit of a headache. Extrapolate that to writing a webapp and it's easy to imagine you would never finish.
And yes, the words 'legendary' and 'classic' are direct compliments to you: your Lin Alg sits next to Spivak's Calculus on my bookshelf. They are both immortal.
1 reply →
Wow! Your textbook looks phenomenal. Eyeballing the table of contents and a few chapters, this arrangement of material looks exactly like what I'm advocating throughout this thread. Gaussian elimination and systems of linear equations before vector spaces, a coverage of fields in tandem with vector spaces, some treatment of sets and functions in appendices, generous usage of matrices to supplement theory...
And you include solutions for your exercises? This is fantastic! Do you have any plans to write something like this for functional analysis?
5 replies →
Thank you for including the solutions to the exercises. This truly is godsend. You have no idea how much it is helpful for those of who try to learn outside an educational institution.
It is very hard to feel confident in learning when I have no way to gauge if I am on the right track or not.
Thanks again.
Solving problems like this is one of the motivators for my nascent BubbleOS project — we need a stable software base that isn't upgraded every couple of years to replace known security holes with unknown ones, also introducing unknown incompatibilities. Executable code is clearly the best representation for many kinds of knowledge, but our existing systems software isn't up to the task.
Your book taught me a lot. I got stuck some of the way in (dropped out of education at 16 - kids and full time job don't offer much opportunity for the focus it deserves). It's the furthest I've progressed with this topic and helped me understand in ways other books didn't. Thank you!
1 reply →
It's true that things went from embedded Java applets (or, eh, ActiveX objects, thanks Microsoft!) to embedded Flash applets to... HTML5/Canvas, but the latter does seem finally stable-ish, especially once web assembly is widespread (which it kinda is, already: https://caniuse.com/#search=wasm)
The technological endurance of LaTeX is legendary, though
4 replies →
Your book is genius. Really. Thanks for making it free.
Thank you for your free book. Another great book is Gilbert Strang's book: Introduction to Linear Algebra. Also Boyle: Linear Algebra and its Applications.
Perhaps your free book can be used to develop some evolving tool for the student. For example: the student take a test and then the book select the best exercises and topics for that student.
3 replies →
Thank you for your book. I applaud all sorts of free texts.
I notice that there is an option to buy your book, and perhaps there are other options to somehow get money to you. I was wondering if you felt comfortable revealing approximately how much money has come to you as a result of your (donated) labours?
2 replies →
I'm also working on an education related project. With projects like this....the truth is, it is mostly a labor of love or passion for the subject that drives you. There isn't much money to be made (even to just support yourself) in creating free courseware. If you want to make money you are better off just working for a traditional university.
You can even see it for yourself. This guy started this project 3 years ago. Fast forward to today we can see that his youtube channel has 500 subscribers and most of his videos have around 1k views...this is after 2-3 years of each video being uploaded. Basically, no one is using this site. It is no surprise that we see so many of these education type projects being half built. The developers eventually toss in the towel.
Personally I think we need a combination of both to really change education though - open educational resources and the associated tools to learn the subject better. Preferably free but also low cost might work or supported by donations.
Right now the big publishers pretty much control the entire market. They own the content and they create the tools. Then they spoon feed it to university faculty (by making tools to basically "drag and drop" the content for teachers) and the student/taxpayers ends up footing the bill for it.
This resonates with "There are no projects like side projects" https://crastina.se/theres-no-projects-like-side-projects/ I wrote a few years ago (and it is still my credo).
Since I create educational projects (luckily, Quantum Game with Photons http://quantumgame.io/ was partially supported by an outreach grant; all other writings and stuff - not so much), I would love to see some way to support such endeavors.
2 replies →
> partly, I think, because most people positioned to author a maths textbook want to use latex; and most people who are able to develop a web app aren't positioned to author a maths textbook
Luckily we have interactive notebooks (like Jupyter) and MathJax for LaTeX. You can have all the beauty of LaTeX typesetting in your browser and make it highly pedagogical with interactive computation.
+1 for Jupyter and Miniconda. I was at a Python meetup recently and one of the seminars was intro to deep learning. It is very easy to setup and quite seamless. Great learning tool as well, because you have output side by side with the teacher’s code. Many modern IDEs still struggle with this (Lighttable being a notable exception).
Most notebooks have Python code in them. How to make that interactive in browser? Are there smooth solutions out there, be it client-side or some hosted service? Or does one have to write all the code in JavaScript?
The only reason I was able to learn any math in college is because you don't need a computer to do it, so you can avoid the distractions. A browser, the source of all the distractions, seems like a really bad place to learn math.
Just because some people choose to get distracted doesn't mean the whole technology is worthless.
I see your point! There is something very focused and calming about having a book open with no screens around. I hope it is possible to recreate this flow state in a browser (because I plan to try over the next few years). I'm imagining a very minimal UI, 66 characters per line typeface, a distraction free mode (full screen kiosk, a la Sublime Text), a 'dusting' of gamification maybe. I have spent hours on Project Euler before without switching tabs so I believe it's possible to focus at a computer, though I agree that a lot of the positives of the textbook experience don't easily translate; but I still believe that, with respect for the learner, their working memory and attention, a great in-browser learning experience can be achieved.
I think it's also the greatest tool for learning there is, so it's worth it to over come that tendency and develop discipline when using it for learning.
as an undergrad who's currently downloading mathematica to play with .cdfs instead of actually studying them, this hits home
I mean there are a million and one useful resources on the internet that enhance learning and just ot getting distracted is also an option
To an extent I disagree. Yes, drawing diagrams can be useful, but simply solving lots of problems is honestly the best way to learn maths. I also much prefer reading from a physical book. Im not sure simple animations will improve things massively.
I don't mind if a book skips some details and I have to fill it in myself, for example drawing a diagram to help understand a key point.
Perhaps in school most people treat maths more mechanically, and exploring requires more mathematical maturity. I don't think some basic animations will improve that directly.
That being said, people like 3b1b on YouTube are in the intersection of people who can animate and know the maths. They certainly produce things which spark the imagination.
I think examples rather than problem solving is the way to go. Some very advanced topics are arcane enough that they really do need hand holding.
Compare Dirac's book on general relativity with one people actually read(To learn from) and you'll see why hand-holding and diagrams are helpful
Two of the authors, Kalle and Tomas, are at Lund University, in sort of the perfect fields for this project - Computer vision and computer graphics (Tomas wrote _the_ book on real-time rendering). I think Jacob is a graphics guy as well.
My guess on the funding is spare time and spare university resources.
>I'm convinced the web browser can help us improve upon maths textbooks printed on paper, but there aren't many 'hypertextbooks' like this in existence (partly, I think, because most people positioned to author a maths textbook want to use latex;
We have much better tools right now such as Jupyter notebook which as accessible to everyone. However, your concept of hyper textbook is intriguing.
What do you mean by that? Can a webpage be an hypertextbook? Then aren't all online books already hypertext books?
Anyways, I am working to build a different medium of learning called Primer. The courses on Primer are basically books that teaches you through conversation. It offers much more than that though. Creates latex pdf, generates flash cards , implements SRS etc. Can you check if Primer matches your description of Hypertextbook.
www.primerlabs.io
Interesting concept, Primer. Just a note: Scrolling is rather erratic on my iPad.
1 reply →
I saw the word hypertextbook somewhere online once and it just stuck in my head. For me, it has come to mean a textbook (so, beautifully typeset, well organised and written, easy to tell where I am, distraction-free) enhanced with code (keep track of learning, tasteful interactives, maybe video, a smattering of ai perhaps). A webpage/app lends itself to this nicely. If I'm honest, the idea is a little inchoate but my instincts tell me there's something to it.
Primer looks like an interesting system - I'm on the mailing list, good luck!
You can write texts in LaTeX, and post them online using Ximera!
https://ximera.osu.edu/mooculus
You can also literately program in Lean, and get out math theorems like http://pat.perso.ens-lyon.org/M1P1/
For another great source of open source textbooks I highly recommend OpenStax (https://openstax.org/). I am currently re-learning calculus and their Calculus text is great. As an aside, I'm currently working through mathematics I wish I had taken in college (I was a biology major), starting with Calculus, and would love to connect with anyone else on a similar mathematical journey!
And for even more open source textbooks: https://open.umn.edu/opentextbooks/
I've been doing Khan academy most days (like, 28 of 30) for the last year. It's been super friendly and I've moved through the algebra, geometry, trig, precalc, and differential material... I'm currently working through some integral calc stuff. I'm planning on doing the stats and linear parts of kahn before trying to take some of the online college-level courses; Sal Kahn is super great as a teacher but I am starting to feel like I can now benefit from some more difficult to digest material.
My hope is to generally increase my math abilities so I can do some electronics design classes and some study about how to start applying ML/ AI tools.
But I've found studying math to be quite fun and useful in its own right. It's fun and I feel like it's helped my general intellectual abilities.
Khan Academy is great, the only issue I have with it is it's too long-winded sometimes. Taking much longer than necessary at the cost of maintaining that comfort level of a beginner student. There is something to be said about struggling just enough according to your proficiency level (the idea of Flow in psychology).
I too would like to work my way up to calculus and beyond.
What sequence of courses do I take on the site to get to calculus, starting from the beginning with the basics?
13 replies →
What was your math background before you started Khan?
5 replies →
I had a look at their pre-algebra chapter. They differentiate between "counting" number and whole numbers.
Why not use the correct terminology and call "counting" numbers "natural" numbers, it's what we've been taught in schools for tens of years, if not hundreds now.
Sure, explain that naturals are "countable" at the beginning, but this redefinition is verging on dumbing down.
edit:
reading further:
"Counting numbers are also called natural numbers."
But they seem to keep calling them "counting" numbers. Just call them their proper name and re-enforce this.
And then in this first intro... below a terrible graphic.:
"The point labeled 0 is called the origin. The points are equally spaced to the right of 0 and labeled with the counting numbers. When a number is paired with a point, it is called the coordinate of the point."
WTF?
I was taught that whole numbers is a wider set of numbers than natural numbers. While "counting numbers" is a good name for natural numbers, because they are used for counting, the idea of countable set is all about our ability to count elements of this set. We can of course talk about countable set in terms of finding a bijection between the set and natural numbers, but it doesn't matter really. It is just different words to spell the same idea, while (we cannot deny it) counting elements is easier to a beginner. Maybe counting numbers is easier to grasp then natural, maybe it is just authors of textbook thinks so. I cannot understand why are you so bothered with it.
> Just call them their proper name and re-enforce this.
I'll tell you a story. When I learned math in college I was stuck by a Galois theory, I just was unable to understand it. So I decided to look different authors, to find some other approaches to explaining things. I found at least one textbook which I was forced to read from a very beginning, because it used a very different notation which I couldn't understand at all.
It was not the first time I have meet a new (for me) notations for things I already knew. I spent two more years learning math, and finally I understood one thing: there are no such a thing as "proper name" in a math. If you need to refer to a some thing, you need to define it. Math is all about your ability to name and to define things, to invent a math notation to write this things down, and to stick your mind to live inside universe which was built by your definitions, names and notations. It is doesn't matter then how original your notation is. All that matter is what results you can achieve.
From all the branches of math algebra is the most about different notations for the same thing. Just take a look at multiplicative and additive notations for groups. You can use either with any group, nothing matter just your convenience. If you like to use a plus sign and write "a+b" then use additive notation. It you prefer to use no sign and write "ab" then use multiplicative one. In algebra it is your respected right to use notation you like. But it comes with a cost: you need to respect other's right to use any notation they like.
You can do better in your own textbooks :)
I've been reviewing the calculus I've forgotten years ago, by taking pictures of my old Schaum's study guide with my iPad, and doing the problems while sitting on public transportation.
I find the badly kerned math typography of the Open Stax offering, and the PDF version of the modern Schaum's study guide, to be distractingly jarring.
It's impressive that they managed to mess that up. They didn't use LaTex for math?
[Deleted comment]
Your product sounds interesting but promoting it more than once per thread might turn some people off, especially around here.
1 reply →
Your scrolling enhancement makes the site hard to navigate. I scroll down and the page keeps sliding, as if I'm skidding on ice.
1 reply →
Similar journey here! It's an exciting journey personally.
This seems like one of the best uses of computers for educational media, one of the ways digital instruction can really shine through compared to physical text which can often require supplemental videos or help from a teacher to elucidate a concept.
Feels very reminiscent to me of 3B1B videos [1] on topics that use visuals to elucidate math topics more clearly as well.
[1] = https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw
In case anyone is interested in a written version of some of the essential points 3Blue1Brown makes, I recently released my own review notes which try to provide a brief overview of some of the main linear algebra topics as well as applications: https://github.com/photonlines/Intuitive-Overview-of-Linear-...
3Blue1Brown's Essence of linear algebra series is the go to place for learning this material. I've included the link to the series below so people don't get lost in all his other wonderful videos along the way.
https://www.youtube.com/watch?v=fNk_zzaMoSs&list=PLZHQObOWTQ...
No offense to 3b1b, the production quality is impressive and the content is effectively insightful.
However, it is ultimately a very limited linear format covering the topic only lightly.
1 reply →
Upvoting this because I think it's really important that we start getting more open source textbooks which specialize in exposition[1]. That being said, I'd make a different arrangement of the material.
Here are a few thoughts:
1. This book embraces the modern take on a rigorous course in linear algebra, which I disagree with. That is to say, it covers vector spaces front and center in the first chapter. Conversely, systems of linear equations (Gaussian elimination) and corresponding notions like row reduction of coefficient/augmented matrices are pushed back several chapters. You see this in popular "flagship" textbooks like Axler's Linear Algebra Done Right because they're prioritizing the underlying theory. I think Gaussian elimination should be covered first because it motivates the material - you're never going to cover Linear Algebra in a way that makes all the pieces fall together in a purely straightforward dependency.
But if you first cover systems of linear equations, you actually motivate the purpose of vector spaces. Moreover, many (most?) proof-based problems in linear algebra reduce to solving a system of linear equations (and therefore reducing a matrix) which is modeled after the thing you're trying to prove. What's the basis of a null space of this linear transformation? You can solve it with row reduction. Is this spanning set a basis of this vector space? Solvable through row reduction. You get a lot of equipment for solving vector space problems if you build up the row reduction scaffolding to a minimal level before vector space coverage. This does not have to temper the theoretical rigor of later, abstract material; if anything it grounds and augments it.
This is why I'm a huge fan of the way that Hoffman & Kunze cover this material. That is a heavily theoretical book, which easily surpasses undergrad-level linear algebra in later chapters. A couple of decades ago it had the spotlight as the really good linear algebra book (it displaced Halmos' Finite Dimensional Vector Spaces, and was itself displaced by Friedberg or Axler). But it motivates a very rigorous coverage of vector spaces by starting with Gaussian elimination, matrix representation of systems of linear equations and (reduced) row echelon forms. If you don't cover this first, you have to either assume the student knows it already or you resign yourself to wading through several chapters of potentially unmotivated abstraction.
2. In my opinion, linear maps should be covered directly after vector spaces. They're a logical succession of the same concept - after you've taught linear combinations, linear (in)dependence, spanning sets, bases, subspaces, and related theorems, it's very easy to jump right into functions between vector spaces. It's just an expansion on all of these things. I would therefore rather see chapter 9 immediately following chapter 2. And much like my prior point, linear maps are an abstraction that empowers a lot of the other ideas; this is mainly because so many things are representable as a linear transformation (much like they're representable as a matrix).
3. The rank is a very important concept, but I would argue it should be subsumed into the chapter on matrices. You can cover anything that doesn't fit cleanly in the matrices chapter in the chapter on linear maps, since you'll need to do that anyway before you cover the dimension theorem. That might be a good argument for simply covering matrix multiplication and addition in prerequisite material and subsuming all of matrices under Gaussian elimination and/or linear maps too...
4. I'm a big fan of the prerequisite material covering basic trigonometry. Trigonometric functions are a good source of exercises for vector spaces. I would like to see an expansion which does minimal coverage of naive set theory (sets, subsets, unions/intersections, etc), functions (injection, surjection, bijection) and polynomials. If you cover the basic definition and arithmetic of polynomials here, you save yourself some space when you cover Lagrange interpolation and factorization later on. It's probably a lot to ask for, but some coverage of differentiation of polynomials would also be useful because the theory of vector spaces gets a lot richer when you incorporate exercises which use a bit of calculus/analysis. In particular, using vector spaces of functions and linear maps of differentiation give you a lot of leeway to show how abstract vector spaces can be without going nuts on the moon math.
5. I've received pushback on this before, but I think it's really important to cover fields as their own subject before covering vector spaces. If you're going to cover vector spaces rigorously, you really need to cover the field axioms. Scalar multiplication doesn't make sense without first defining a field (you can handwave it, but it's easy to make subtle mistakes - like missing that the set of all integer $n$-tuples cannot comprise a vector space). Likewise you ordinarily need your linear map to agree on a field to be well-defined. This coverage would ideally also establish the basic facts of the real and complex fields, which are almost entirely the fields you work with in undergrad linear algebra.
6. I don't see any exercises. A good math textbook challenges its reader to internalize each chapter's material by substantially using it to prove further material. By not including exercises, this text becomes more of an illustrated monograph. That's totally fine if it's what they're going for, but I think there's a huge opportunity to tailor it even further with targeted exercises that expand on the theorems in each chapter.
Note that I'm mostly nitpicking here, even if I think my critiques have merit. The exposition of material is much more important than the arrangement of material, as long as things are building on each other rigorously. I'm not trying to say the textbook is bad; this is just a stream of consciousness about my opinions on arranging linear algebra for maximal pedagogy. You generally have to supplement textbooks in order to get a rich understanding of the subject matter anyway.
On the plus side, I'm a huge fan of the way they present vectors geometrically. That's a huge win for illustration/animation purposes. I do think there's a missed opportunity to make a sexy illustration of transforming a system of linear equations into coefficient, unknown and constant matrices; then from there illustrating the transformation of the augmented matrix into its reduced row echelon form.
__________________________________
1. For pretty good open source, undergrad-level textbooks in Abstract and Linear Algebra respectively, see http://abstract.ups.edu/aata/ and http://linear.pugetsound.edu/html/fcla.html respectively.
I like this idea. It's also how the subject developed historically. That said, don't you get a very computational book in which students spend a lot of time working with matrices filled with numbers if you teach Gaussian elimination first? How do you make sure that students understand the big picture? After all, modern linear algebra is a lot more than the Gaussian elimination algorithm. I'd even go so far as to say that if a student don't understand Gaussian elimination but understands everything else and that there exists some algorithm to solve linear equations, they'd still get 95% of the value of a linear algebra course.
Maybe you can do that if you make it very visual like the book linked in this post, so that you bring in the geometric concept of a vector and link it to linear equations, rather than only working with tuples of numbers. For example, linking the visual concept of linear independence of a set of vectors to a system of equations having a unique solution. If you do that you may be able to teach linear algebra from a linear equation solving point of view, while not getting bogged down in manipulating matrices of numbers.
> After all, modern linear algebra is a lot more than the Gaussian elimination algorithm
This is kind of my point - there actually isn't a whole lot more than Gaussian elimination at the core of linear algebra until you get to rings and modules. Of course I don't mean that in the sense that there aren't important definitions or topics. The theory is very rich. What I mean is that most theoretical questions you can ask about vector spaces and linear maps (or more abstractly, the linearity of a thing), are reducible to a matrix representation and Gaussian elimination.
You don't have to use Gaussian elimination, and I'm not arguing the course should become rote computation of matrices. There is a middle ground. For example if I hand you a linear map and ask you about the dimension of its range, you can identify a spanning set, refine that to a basis and you have your answer. You could also just take the rank of the matrix representing that linear map reduced to row echelon form. I don't think you lose much theory one way or the other.
But I could be wrong - if you have a specific example I'd be interested in hearing it. I've tried to declare front and center that I'm biased from learning linear algebra through Hoffman & Kunze. Halmos also grounded his (very theoretical) book in a generous use of matrices. Not covering matrices until later is a fairly recent development, and I think it's because (for reasons I've stated elsewhere) many professors don't distinguish between the rote computation of matrices and the rich theory of matrices.
1 reply →
Apart from Gauss elimination, I think eigenvalues, eigenvectors, scalar product, orthogonal subspaces, and the relation to statistics are important. Statistics associated with SVD, principal components and other topics are a main source of insights. Also Fourier basis is an important concept far beyond Gauss elimination.
Of course, I'd agree. But my comment is pretty long as it is, and is more concerned with the arrangement of material than how many extended topics you cover. I'm treating perfection as nothing left to remove, not nothing left to add :)
This is interesting, but I think there's an implicit assumption here that a particular topic must be covered in depth, at which point its study is completed, not to be returned to.
And indeed, this is way many textbooks are structured. But I see no reason for this to be the case. If topics are covered lightly via an exposition and then subsequently drilled into in depth, the order, and resulting motivation becomes almost a side note.
I say this as I'm currently studying linear algebra via Coursera, and the resource that has become most valuable to me is a Scapple board with a bunch of screenshots, text and arrows. It is this (non-linear) diagram that I return to most often to help internalize and solidify my learning.
In this regard, the order of exposition becomes almost incidental.
I think the problem is a tension between what’s valuable to us in learning and what's valuable to us after learning.
So when I was tutoring, I noticed that my “standard approach” failed: a kid would have a homework problem, I would say, “Here's how you want to think about that problem, it’s (say) a conservation of energy problem, calculate the energy before and after...” and it fostered no real learning! I thought the problem was that I was subsidizing laziness—stepped back a bit but gave lessons after some struggling—and that didn’t hurt much but it didn’t help much either. They were motivated, just the didactic structure was not working for them. I started to ask questions, and that was a bit more helpful, but found that I myself was somewhat unguided about how to accomplish “Socratic teaching” so that they could benefit from it—if you can believe it, my default approach was to try to introduce the same theory ideas as questions from the start, “would conservation of energy apply here?”—so no wonder I only got mixed results: it was basically the same thing.
But questions gave me a way to get off that map, because I started to ask tutees to give me expectations and examples, and somehow those worked well. “What can we expect that this system does, within a few orders of magnitude? Can you give me some examples of similar systems and how they work?”
I think that in order to learn abstract things, we need to first have a bunch of examples in our heads, things that all kind of fit together but do not make sense. The abstraction unifies the examples, helps us remember them and fit them together. We can use each example to test the abstraction for fit, to massage our cognitive ability from one context into another.
When we build a building, we need frameworks and scaffolds to build it. When the building is freestanding, all of that effort of building the scaffolds can be undone, the scaffolding comes down, it's no longer necessary. We go back to a textbook and we want a picture-book: show me the building, and just the building, and nothing but the building. Let me feel lushly indulged by its architecture, by photographs that go into detail in the really rich areas—I want indulgent artistic experience, because that's what the building is!
We have a constant tension in textbooks between the how-to-manual—spartan, practical, containing all of these scaffolding steps and nitty-gritty–and the coffeetable book—rich, whimsical, pop-simplified.
Griffiths’ Introduction to Quantum Mechanics begins with a prologue to this effect, though I thought it was just a quantum quirk at the time I think it's actually much more general now. He says [these will not be exact quotes] that, “This book will teach you to do quantum mechanics because I strongly believe that this has to come before any sort of strange discussions about what quantum mechanics is.” It’s one step between Feynman’s “don’t even try to understand quantum mechanics, just shut up and calculate” and Searle’s response “I’m sorry, I am a philosopher and literally the only thing anyone pays me for is to try and understand things like quantum mechanics.”
And I think that is where I want to focus my teaching efforts, that every textbook should kind of have the appendix coffee-table section, I’d even like to carve out a new name for it and call it an “abridgement” or so, at the end. The book Mazes for Programmers has an appendix like this of “let me summarize all of these maze generation algorithms and their essential properties and their essential approaches” that I really loved, it makes it an absolute joy to keep this thing on the bookshelf and come back to it time and time again. The main text has the “Here’s how to do it” information, the appendix has the polite overview of what was just built that is great for returning to.
Yes, I think you've captured the problem pretty nicely. This is the problem I have with doing something like defining vector spaces on arbitrary fields F (not even R or C!) before you even talk about linear equations. The theory of linear algebra is rich and useful, but it's hard to motivate it that way. I don't mean "motivate" in the sense of, "Why should I care about this, and when will I use it?", because you don't always need that kind of motivation to do math. I mean motivation in the sense of, "Why did people come up with this theory? What led them to these definitions, and why are these definitions the right ones?"
I have seen the hierarchy of math presented like this:
1. In high school, you're taught how to compute arc length. You need to do nothing but calculation, and it doesn't matter why it works.
2. In undergrad, you're taught to prove the formula for computing arc length. Given the theorem statement and the requisite axioms, you can show that the formula works.
3. In grad school, you're taught to derive the formula for arc length from first principles. Given a set of axioms, you come up with the theorem and prove it from scratch.
4. In research, you're not taught anything. Instead you solve the questions, "How should I define arc length? Why does my definition of arc length matter, and where is it useful? What can I prove with it?"
Contrary to (quite a bit of) popular opinion, I would hold that a truly rich understanding of the theory can only happen in the context of the trigger for the theory. You don't need to understand the context of systems of linear equations, or why linearity is a useful concept, to understand vector spaces. But it's a lot easier if you have that context. Likewise you don't need to use Gaussian elimination to solve a lot of questions which ask you to prove something about a vector space or a linear map. But if you have that context, you can use it in your proofs instead of miring in towering heights of complexity.
Incoming tech seems about to change the texts-and-tutoring constraint and opportunity space. I wonder if it's time to start thinking and exploring ahead?
Consider an art project, where you sit in a booth, and watch an interesting video drama. But why is it interesting? The video is a graph of segments, like an old "choose your own adventure" story. And there's an eye tracker watching you. So if you're interested in characters A and B, the story mutates to emphasize them.
Consider a one-on-one tutor on a good day. Noticing a student engaged and enthused, they might reorder content on the fly to leverage that. Might emphasize different aspects, and alter presentation, based on observed interests and weaknesses. Or consider working with a young child, watching them read word by word, noticing their where they hesitate and frown, probing for their thoughts, adjusting difficulty, providing a path of development.
What if that was math content rather than a drama or children's book? What if we could do this at scale? Eye tracking is just one tech coming in on the coattails of VR/AR. A setting for personalization AI is another.
What if saying "the best way to organize and present this topic in a textbook", becomes like saying "the Capital mandates, that every teacher of this grade, will today all teach the following lesson, by saying the following words, regardless of local context"? While not on a national level, that is a real thing.
What might it take to start encoding an adventure graph for linear algebra? The "oh, if you like this perspective on this topic, you might like this similar perspective on this other topic"?
Or if we don't have the tooling for that yet, can we start thinking about the tooling? Or fruitfully do something else now, in preparation for opportunity? Perhaps Kahn academy problems in more flavors, in a richer graph? ML-based textbook aggregation, synthesis and retheming? Perhaps it's all not ripe yet. But something else, maybe?
3 replies →
If you read the older editions of physics (and my comment applies to physics, not math) textbooks like Lanczos and Kittel (let’s leave Landau out of this) where the examples and problems are interspersed in the text often with solutions, the clear implicit invitation is to the students to come up with their own problems (ideally paradoxes!). This is related to point 4 in throwawaymath’s comment: https://news.ycombinator.com/item?id=19265709
If you don’t expect them to be potential future faculty, then by all means let other people hand you the problems and paradoxes unless you’re in contact with experiment.
This. It’s a daily trade-off, as a working professional, between how deep I should learn the fundamentals and how quickly can I get to solving problem at hand.
As an example, I want to learn how to deploy my models on the cloud but the mechanics of how computing on the cloud works is a depth trade-off. I wish I could learn all about distributed computing concepts but I find that I have neither the time or energy for it, at times.
> When we build a building, we need frameworks and scaffolds to build it.
This SIAM published Linear Algebra textbook makes a point about the scaffolding, too: http://matrixanalysis.com/Scaffolding.html
nit: The Feynman bit is a myth: https://physicstoday.scitation.org/doi/full/10.1063/1.176865...
And Searle is an interesting argument for Griffith's perpsective. Searle rose to fame talking about stuff he knew how to do ("speech acts") and in his later years embarassed himself with bad criticisms of AI, as in the Chinese Room, his garbled continuation of the fallacy of the Philosophical Zombie.
1 reply →
I like this pedagogical structure. Why do you think so many people recommend Linear Algebra Done Right as a first exposure to the subject?
Because in fairness, it does do so many things right. It's kind of controversial[1] because of Axler's notation and de-emphasis on determinants. But it's an ideal book to give a student who has had a first, computational course in linear algebra (i.e. a course entirely devoted to solving systems of linear equations and drilling matrices).
I think Hoffman & Kunze is really the best textbook for the arrangement of material I'm talking about, but it's outdated at this point and its exposition is strictly less pedagogical than Axler. My vision for the "perfect" linear algebra textbook would be loosely based on Hoffman & Kunze, but replacing a lot of the theoretical exposition with Axler's exposition from Linear Algebra Done Right, then keeping (and even expanding) the mterial on Gaussian elimination and matrices. You could get a solid three-semester sequence of computational and proof-based linear algebra out of such a textbook, and you'd be all set to go to something grad-level like Roman.
Unfortunately it's also hard to judge a lot of linear algebra textbooks because the bifurcation between proof-based and computation-based linear algebra isn't as clean as it is in calculus. Calculus has its own separate course sequence in real/complex analysis, whereas linear algebra doesn't have a distinct name for the more rigorous coverage of the subject. So you have a lot of textbooks which choose one or the other thing, which then results in an over-emphasis on computational stuff in the first course and a complete de-emphasis on the motivation in the second course. When you are learning these back to back in distinct courses that's usually fine, but many first courses actually jump right to Axler despite the words of caution he writes in his own preface.
__________________________________________
1. Noam Elkies uses it when he teaches Harvard's Math 55a. See his list of comments and errata for the book: http://www.math.harvard.edu/~elkies/M55a.17/index.html
1 reply →
have you looked at "Matrix Analysis and Applied Linear Algebra" by Carl Meyer? it seems very in line with what you're saying and the exercises are absolutely excellent. I've slowly made my way half way through the book and am very happy over all
If rank is put where you want, the presentation of the Nullity-Rank theorem will be less than ideal.
Why is that? Note that when I mention the dimension theorem, I'm actually referring to the fundamental rank-nullity theorem.
To be more clear, what I was suggesting is to take the section on rank, toss that into the section on matrices, and then toss that into the section on Gaussian elimination (preceding vector spaces). That's useful because the rank of a coefficient matrix tells you the nature of the solution space of the corresponding system.
Then when you cover the rank-nullity theorem in the chapter on linear maps, you'll have the context of 1) what rank means in a matrix, and 2) what rank means in a linear map. That sets up a deeper understanding of how to verify the rank-nullity theorem for any linear map by finding the rank and the nullity using the basic and free variables of the reduced row echelon matrix.
1 reply →
I thought matrices were pretty cool when I took Linear Algebra in college. However, I hated doing the computations by hand; it makes one really appreciate computers.
I recently released my own review notes which try to provide a brief overview of some of the main linear algebra topics in an intuitive / geometric manner in case anyone is interested: https://github.com/photonlines/Intuitive-Overview-of-Linear-...
I've been working on this for the last two years, I've just started writing content for it :)
http://treena.org
The website looks a but weird on mobile [0]. It’s still readable but probably removing the left image would help already.
[0] https://imgur.com/dzidyuV
This reminds me of the mobile game Euclidea, which is a puzzle game where one must build geometric figures with as few operations/tools as possible: https://www.euclidea.xyz/
It's really well designed, give it a try !
There is a similar interactive linear algebra book from Georgia tech : https://textbooks.math.gatech.edu/ila/
Highly recommended.
Another interactive math textbook: https://mathigon.org/
Wow. That is an amazing piece of work.
This is fantastic! I'm planning on taking linear algebra in the fall and a glance over this makes me think it will save me tons of time searching youtube and etc for explanations of trickier concepts.
3Blue1Brown's youtube channel is great too for visuals and theory. I taught myself linear algebra pretty easily combined with this book.
Reminds me of http://setosa.io/ev/eigenvectors-and-eigenvalues/
20 years ago, when web browsing was still newish, I would have expected HUNDREDS of interactive-learning sites like this to have been set up by now. I am very glad to see this!
Thank you so much to ease my life.
Do anyone know any such type interactive books which is related to ML, i don't mind purchasing.
Thanks for the link. I have been meaning to brush up my Linear Algebra for some time now, I’ll give this a serious try.
Side note: anyone else notice that if you scroll up or down really fast (in mobile) the spinning logo starts to go faster & faster. Cool Easter egg!
I really like the concept...but where do people pronounce algebra that way? It sounds like a computer trying to sound normal (to my ear. I'm more of a Al-Ja-bra kind of guy, not Al-Ga-bra)
I need a resource like this for group theory.
Try http://abstract.ups.edu/aata/. I have no affiliation with the authors, but I think it's really quite good. Symmetries in particular have a lot of illustration.
Thank you! I'll check it out.
https://www.amazon.com/Visual-Group-Theory-Problem-Book/dp/0...
This is targeted at the beginner. Maybe someone else can comment on how good it is. Doesn't look to be interactive, but more pictorial based.
I'll check this book out. Thank you!
I want interactive proofs to learn linear algebra. I'm trying to build something, it's daunting.
Interactive proofs?
Yes. Unfortunately that term is taken by some cryptography thing. A proof assistant or interactive theorem prover to be more precise.
Great idea.
Learners can interact with book.
Is there anything similar available for Tensors?
Ouch, their Forum is full of spam.
yes! interactivity is where it is!
Is this still being worked on?
Правильно говорит. Пользуюсь Firefox
I need something like this for group theory.
test