Comment by grahammccain
7 hours ago
Guess what this is probably fine. AI helps people do their work on a daily basis and probably makes them memorize less things. That’s how the world is moving. You don’t need to be able to memorize something for an exam to show mastery of a topic. And we shouldn’t organize our society around memorizing things for exams.
What is a doctor? The person recommending next course of action based on best practices. What is the best practice? Is it a globally decided on thing, a locally tested thing that has proven to be better? Is the global thing just the most popular because someone wrote it on reddit and it got millions of views (but isn't actually good).
If our society is organized on just delegating all authority to "the best answer" we can drop all jobs - and only the surgeon has some authority over the machine. When we have a surgery robot, then they can go to. And at some point we'll be recommending and forcing surgery for athletes foot because some kind of best practice or viral post going out of control and a bunch of openclaw bots randomly decide to make tons of recommendations online for amputation for athletes foot and GPT 8.6 agrees this is the way to go.
OR we can somehow decide there is a boundary, there is some room for human memory and decisions.
I actually think having a single source of truth would not be terrible. Let me explain.
All podiatrists are not the same. All physicians in their specialties are often specializing in their own niche and are up-to-date on that niche.
I've had lisfranc ligament injury. My podiatrist wanted to perform a surgery quickly, which in 90% of cases is advised. I decided to seek a 2nd opinion because I realized she did the X-rays wrong, as she did them non-weight bearing, which is useless if there are no fractures.
The specialist was excited to see me, and up to date on all the lisfranc research. I've had a really bad sprain and he said conservative treatment should be sufficient. It took months but I healed up.
I've had quite a few injuries from playing sports and often found doctors to be "wrong" simply because their knowledge was out of date.
I am confused as to how this is an argument for a single source of truth. It seems like you've presented an argument for the opposite. If there were a single source of truth, there would be no point in seeking a second opinion - it would be the same as the first. If the first opinion was correct, excellent. But if the first opinion was incorrect (and no AI model is correct 100% of the time), then you're straight out of luck.
1 reply →
> I actually think having a single source of truth would not be terrible.
We should establish a single practice of care, MedicineGPT. It may be a rough start but over time the gene pool will adapt and the human race will live harmoniously with the machines (sorry, with the GPUs). Plus our insurance premiums should finally go down.
2 replies →
> What is a doctor? The person recommending next course of action based on best practices. What is the best practice? Is it a globally decided on thing, a locally tested thing that has proven to be better? Is the global thing just the most popular because someone wrote it on reddit and it got millions of views (but isn't actually good).
Ironically I had a friend who went to med school and in his own words roughly 90% or more of the students there are heavily relying on GPT. They even had a few instances where people were using it to cheat during exams. And supposedly during the clinical years of uni if they don't know something they literally just go to a separate room and start asking GPT for answers. Make of that what you will.
This is too simplistic. There are disciplines, like Anatomy, where you're basically just memorizing bones, glands, and other parts of the human body. For organic chemistry, students need to memorize most of the krebs cycle diagram for their exams (because doing so and drawing it lets them reference it later).
Thinking is infinitely more complex than "critical thinking" vs. rote functions. You want students to get to critical, eventually, but the lower orders on bloom's taxonomy serve important roles, too.
Course design built around multiple choice questions, essays, and a lot of the historical assessments that we're used to are largely not great for learning in the first place—–they're used because they can be auto-graded or score assigned quickly. AI, conversely, is kind of revealing the limitations of these outmoded learning design practices.
Think of the meme going around right now from Milennials to Gen Z: "I wrote a 5 page essay on a book I never read!" <- They're saying this to AI generated essays as if there's any difference in the critical thinking that comes out of an exercise like that (read: absolutely none).
AI is a new tech—so of course people are still figuring out the limits of it. In 10 years a lot of the paradigm will be set. Until then, students are unfortunately kind of in the thick of it.
>Think of the meme going around right now from Milennials to Gen Z: "I wrote a 5 page essay on a book I never read!" <- They're saying this to AI generated essays as if there's any difference in the critical thinking that comes out of an exercise like that (read: absolutely none).
As somebody that read every mandatory reading book, I wish I had had the critical thinking skills to not read them. In retrospect, they were a waste of time and made me absolutely hate reading.
How do you differentiate between mastery of a topic and mastery of using an AI in an exam setting?
Open book tests and allowed cheat sheets already solve the memorization-is-not-required gap. It seems like allowing use of AI pushes that closer to thinking-is-not-required. And if no thinking is required, then how can you prove personal mastery?
If no thinking is required, why do you need thinking in the first place. Seems useless. If an ai can do it, why you need a human to be able to do, human should be doing something the ai can't.
Mastery requires memorization.
You can't play an instrument without muscle memory.
Why are commercial airline pilots required to spend hundreds of hours in simulators? So that when things go wrong they don't have time to think, they just react. And their reaction will be the correct course of action because that's what they have drilled on.
How many times have you gone "Oh, this new thing I have just encountered reminds me of this other thing?". How can you make such leaps without knowing that other thing?
Good exams don't just test memorization
Yup, when you find such exam please let us know.
I had the privilege of being educated in several countries and cultures. This might come across as "your education system sucks", and that's essentially what it boils down to, but on the upside I'm truly sorry for you and will oppose a comment to your cynicism. Good exams test your ability to express coherent thoughts about the concepts you learned, and let you generalize upon them by having you use and combine them to solve cases and problems that were not those seen in the teaching material. You can even teach and test history that way, and make it much more insightful and captivating than a laundry list of dates and events (as I suppose was your case?)
1 reply →
[dead]
> to show mastery of a topic
How do you show mastery of a topic where you neither understand fundamentals nor have skills to do a task without help?
Mastery is about demonstrating skills. Skills take practice, hands down.
AI can help us build better tools, provide tutoring, answer broad ranging questions, help relate concepts, and do reasoning for us. All of those things can be good in that they can help us acquire skills faster, e.g. with better practices and exercises. But it cannot replace actual time spent doing a thing.
Wanna learn knitting? You're going to have to knit some stuff.
Completely agree.
Absolute waste of time getting babies to walk now that we have cars and electric scooters!
A lot of expertise is actually knowing things about the domain. You can't make a good judgement call on a topic without getting relevant knowledge in your head to make that decision. You can't even lookup the relevant knowledge without knowing what knowledge is important to make the decision, so reference material is not enough.
I can get quite a lot of knowledge on a domain pretty quickly these days. But yeah domain is important
Memorizing stuff is good for understanding. Of course memorizing without understanding doesn't really help, which is what a lot of student last-minute "cramming" boils down to. But without concrete and memorized knowledge, any abstract reasoning skills become quickly impossible.
Wrong. Memorizing without understanding is pointless. And I'd argue that rote memorization does nothing to guide ones understanding. Because if you actually understand a subject deeply enough you can literally derive almost anything that would need to be memorized on the fly, and if you can't (say constants, or spec information, or anything else) you can simply surgically look it up online (or via an LLM).
> Wrong. Memorizing without understanding is pointless.
GP said exactly the same thing.
I agree with GP’s broader point, which is that you cannot have understanding without a specific set of baseline facts. The student studying only those facts and never achieving the understanding they are meant to support is a tragedy of our education system.
There are people who need to understand microbiology at a specific level and they cannot derive it all on the fly. They can achieve better memorization through understanding but I personally have found rote memorization can be an essential first step in some disciplines.
Have you never watched The Karate Kid?
"Wax on. Wax off" -- memorization and repetition are the basis for understanding.
How useful it is to remember useless information that one day turns out to not be so useless after all.
A good analogy to caching and memory lookups. You store in your head only the most valuable immediately necessary information, the rest can be outsourced.
This is not, in fact, fine. The point of education is to learn things, and these results show that kids are not learning things as effectively when they use LLMs.
"You don’t need to be able to memorize something for an exam to show mastery of a topic."
Yes you do???
One more step towards eliminating the value of labor entirely. What "work" will people be doing on a daily basis, and what makes it valuable?
so how _do_ you show mastery of a topic?
> You don’t need to be able to memorize something for an exam to show mastery of a topic.
Yes, you do need to memorize and know things about the subject in order to be a master of it. What is the definition of "mastery" that you are using? What are the Things being memorized?
Definitely not fine. People are graduating from Computer Science programs literally unable to write a line of code without AI assistance.
These people have fallen into OpenAI and Anthropic's trap and are illiterate without the assistance of coin-operated slop generators.
Yup this is the devious plan.
Thank god for china!
It's critical to understand the fundamentals on your own and that is different from AI being used in public. Sure school doesn't have as much value as it used to but it was always more about social credit or a certification that you took the time and effort to understand the world under pressure (obviously not true for all disciplines) or goals attached preferably in group settings.
This is something that AI cannot replace. Viewing things as memorizing is the wrong take.