Comment by dnprock

6 years ago

This article is fun to read. Incidentally, my daughter just took a test for a gifted program. She didn't study for it as recommended by our school district. She scored 95% in one subject. But the qualified cut-off rate is 98%!

My eyes just rolled looking at that number. That means they only pick 98 and 99 percentiles. For a first grader to score that high, she needs to answer the exam perfectly. If you have some statistics training, you'll see this score is like shooting yourself in the foot. You're more likely selecting prepared test takers than gifted students.

I congratulated my daughter on her score. We went out for dinner and got tasty pastries for dessert. Life is too short to waste our time on these dumb tests.

> She scored 95% in one subject. But the qualified cut-off rate is 98%!

> My eyes just rolled looking at that number. That means they only pick 98 and 99 percentiles.

Either one of these is wrong, or they somehow managed to craft a test where the score percentage matches the score percentile, which while possible to engineer is somewhat improbable and also contradicts the next sentence:

> For a first grader to score that high, she needs to answer the exam perfectly.

Irrespective of one’s current grade level, it doesn't require answering an exam perfectly to get a 98%. It might to get a 98 percentile score (depending on what other people taking the score get).

> If you have some statistics training, you'll see this score is like shooting yourself in the foot.

If you have some statistics training you'll recognize the difference between percentages and percentiles and which of the former corresponds to a perfect score.

The test-retest validity of IQ tests (which tests for gifted programs either expressly are or are equivalent to) is such that it's not unreasonable at all to think that people will consistently score at about the same place based on ability over a short time period (over a longer span there'll be some variation) and that being a prepared test taker isn't a particularly significant factor, though anxiety about testing or the particular test could depress scores and soothing that is the main benefit of test prep.

Yes, the levels most districts use a gifted cutoff are very high (usually 97th-99th percentile). Yes, that means very few (1-3%) will make the cut. No, this doesn't mean the people that make the cut are just test-taking prodigies.

  • It's a form of Goodheart's law [1]. If you use the test scores to select for gifted students and the requirement is this high you will only select for highly test prepared students (the set of prepared and gifted or prepared and capable students). You're final student selection will be higher correlated to preparation and less to how naturally gifted a student is. This is not necessarily a bad thing though.

    [1] - https://en.wikipedia.org/wiki/Goodhart's_law

  • If the optimisation problem is “pick a set of kids that can finish the curriculum quicker as measured by standardised tests” then any effective screening test is likely to select for “test taking prodigies” since that is the leading measure.

    RE percentage vs percentile: I think you may be wrong here. Take for example, uni exams. 40% is the pass mark here in old Blighty. The exams are standardised and the 40% threshold is not a percentile. In fact, it makes almost no sense at all to stackrank every cohort of test takers. It wouldn’t be fair at all not comparable over time. I think the parent poster is correct. Doubtless the empirical distribution of real scores are used to decide cutoffs for grades, by 99% in the parents posts very likely refers to a percentage.

    • Gifted classrooms are funded by a budget and have a certain number of seats available. In must be a percentile selection (mixed with subjective judgments, diversity, etc)

      3 replies →

I was in the gifted program when I was in elementary school and I don’t recommend it. It took a kid like me who was already prone to social isolation and isolated him further. I voluntarily left the program after 2 years and was playing catch up socially and I wasn’t any better off academically. Don’t put your kids in that program.

  • I think there's a right and a wrong way to run these programs. Some schools just pick a couple of outliers and make it obvious they're outliers. If you're going to group some kids by ability for some classes, do it to everyone. Yes, a few kids are really advanced. A few others are almost there. Don't make the first group so uniquely isolated at the expenses of making the second group miss out on similar opportunities entirely. I see the benefit of keeping everyone together some of the time, but I'm screaming inside when I see my daughter reading at a 3rd grade level next to kids who still don't know the alphabet, and her teacher has to keep them all in one big reading group. She has an alternative but it's strictly an addition to all her other work: which is how it was for me, so I got A's in the gifted program, and D's in my regular school work because it seemed pointless and stupid. My high school was only told about the D's so it took me 2 years to get back into Honors classes. Whoever designed that program was not gifted.

    Let everyone spend some time grouped by ability. Don't just burden them with more busy work. And please make sure the teachers running special programs have a clue what they're doing to kids...

    edit: Furthermore, I always thought it pathetic that I went from being a very average student in 2 other countries, moved to America and was suddenly seen as a gifted genius who was years ahead of my peers in math and science. I've obviously never seen it that way - I think kids are capable of for more than the American school system expects of them, but their intellectual growth is being stunted at a very young age.

    • The right way to run a gifted program is to have class placement tied to ability, not to age. If someone is good at math, put them in the next higher math class. If someone is good at reading, bump them up. It works well for under-performing kids as well: if they fail math, they can retake just that class and continue in the rest.

      This keep gifted kids challenged while not pushing anyone through too fast.

    • There is one more thing that is important that most people miss: a "gifted" student (whatever that means) mixed in with the rest challenges the other students to do better.

      3 replies →

  • I was fortunate enough to get into a GATE extracurricular program when I was in elementary school in the East Bay, a long time ago. In my case, I got to socialize more with some peer groups, visit a planetarium, make oddball things, get a good grasp of the sciences way ahead of the regular school curriculum, and participate in a problem-solving program that influenced my thinking for the rest of my life.

    BUT: in retrospect, those programs are mostly for kids who just happened to be fortunate enough to be born into the right circumstances at the right time. East Bay public schools were pretty good at the time, I was born just in time to learn about computers just ahead of the rest of the world, I had a somewhat stable home life, and my family supported learning and nerdy hobbies.

    I was a social outcast for most of my youth too, but that had less to do with GATE and more to do with my family's obsession with being smarter than everyone else, which made me an insufferable, lazy little jerkwad. It took getting out into the world in my late teens to begin realizing just how much of an idiot I really was.

    So, YMMV, but if I were a parent I'd at least give a local GATE program a try. (But also sports.)

    • > more to do with my family's obsession with being smarter than everyone else, which made me an insufferable, lazy little jerkwad.

      Massive props to you for having the self-awareness to make that realization. So many people don't.

      And so many smart people fail to realize that being smart is just one gift among many. And all things considered, once you reach a certain minimum, other attributes are probably more important in life success (like work ethic, and social ability). It took me until my mid-20s to make that realization.

    • Did California's GATE actually have a purpose? I was in it for 13 years (~1982-1996) and it seemed completely and utterly pointless. No extracurriculars, no meetings, no resources... it seemed like a smart-kid inventorying service for (insert random conspiracy theory here). Worse, I was constantly pulled out of class to take IQ tests and then bored to death because I was 3 years ahead after coming from a private school that had phonics and aggressive material plans (Challenger).

  • I would imagine it varies a lot. I went through three different programs in my midsize town growing up, with different class sizes and teachers. They varied in many ways and one way was the attitude of other children. When the program was large, like a magnet school, there weren’t social problems. When we had a class of 12 kids in a school of 300 we were ostracized.

    I stood out so much in normal classrooms that it was difficult to participate. I was about three years or more ahead of everyone, reading at a college level in fourth grade while some students still struggled to read compound sentences. I felt very fortunate to be put in a class with a few people my age who were at a similar level of intellectual ability.

  • I was in a similar situation. My elementary school recommended to my parent that I skip a grade and join the [GRADE+1] cohort, which would remove me from my (already small) group of friends. This ended up happening over my strong, for a 10 year old, objection. In the first quarter I deliberately engineered my grades to be all C’s (was previously a straight A kid) which triggered school admin to reverse the decision. I consider this my first “achievement unlocked” moment.

  • It was the best thing that happened to both of my step kids. They met great people, learned amazing things, socialized with people who had common interests and talent. Best of all they stopped hating school and flourished.

    I only regret it wasn't around when I was young.

    • I was in "GIFTED" in elementary and middle school.

      The elementary school one was amazing, and I would recommend it to anyone.

      The middle school one was mediocre at best. I liked it, but it wasn't actually any better than regular classes.

      So it can vary pretty wildly, even in the same school system.

      1 reply →

  • I was also in the gifted program and the thing that helped me the most was getting involved in youth sports like little league, rec basketball, and soccer. It allowed me to be friends with both the smart kids and athletic kids. I can't stress enough how important youth sports are for kids

    • Let me guess. You don't have a coordination problem?

      I do. I received about a year of therapy for the fact that my left hand quite literally doesn't know what my right hand is doing. That helped. But being clumsy still made school sports really unpleasant for me.

      Just because sports was right for you doesn't mean that it is right for everyone.

      7 replies →

  • In middle school I was placed, by standardized testing, into bonehead classes, where I was extremely bored, not because I was so smart that I knew it already, but because it was boring. I took a writing elective course, impressed the teacher sufficiently that she got me into eighth grade honors English, where my dear teacher lectured on grammar like it was a game of chess. I lived it, but I struggled to get my C. Getting extra credit for reading Chaucer, on my own initiative, probably made the difference--or more likely my teachers good will and support. Teachers count.

    Not sure I would have ended up where I did but for their intervention.

    • >where my dear teacher lectured on grammar like it was a game of chess.

      The greatest teacher I ever had was a middle-school english teacher who marked strictly on the basis of attendance and participation, never opened a textbook, enthusiastically read aloud from books of his students' choice as if he were performing them professionally on stage for half the class time, and spent the other half of the time just casually discussing the books with the students. The first words he said to the class on day one was "I don't want to hear the word preposition, and I don't think you do either."

      2 replies →

  • I was awkward, and it was about the only place I could focus entirely on academics and be among peers that valued that.

    My identity is complicated (and queer) and while my adolescence would have been a mess no matter what, having something that I could work hard on and had meaning - grades - made a ton of difference. At a school where everyone was an awkward geek, I didn't stand out.

    I'd do it again in a heartbeat.

  • I am sorry that your experience was so terrible, but the plural of anecdote is not data.

    For a counter-anecdote, my experience of gifted programs is that it was the first place where I wasn't bullied for being more interested in books than sports. This didn't help me fit in with other kids my own age, but it did wonders for my self-confidence and significantly improved my odds of having a decent life.

    My wife's experience is similar.

    The moral is that gifted programs are not in and of themselves good or bad. What they are is good for some kids and bad for others. The trick is figuring out which is better for any particular kid.

    • > the plural of anecdote is not data.

      ... and the definition of experience is not anecdote.

      I think that 2 years of experience qualify as data. Anecdote is when you walk in a street and slip casually in a banana skin once.

      7 replies →

    • >I am sorry that your experience was so terrible, but the plural of anecdote is not data.

      Actually it is. Data is just many individual anecdotes collected. They just need interpretation.

      5 replies →

  • I don't think that's always true. I found "gifted" programs much less isolating that regular school. I was lucky enough to participate in some summer academic programs, and while I still had a lot of social difficulty, at least there was a feedback loop where people would engage with what I was saying and I could evaluate and adjust my behavior according to people's reactions. I remember gaining a lot of social confidence in those summer programs and going back home and starting the school year thinking, I'm finally catching on, I've learned how to engage in this back-and-forth where I interact with people and watch their reactions to me, I've learned how to learn, only to go right back to being isolated and mystified in school, unable to see a relationship between my behavior towards people and their behavior back towards me.

    For me, I needed to have a little bit more in common with my peers before I could even get traction socially. In fact, it might have been a net negative for me to be surrounded by other kids and cut off from them at the same time, because it messed with my confidence so badly. In the long run it is proving harder to unlearn the bad habits that stemmed from that than it was to learn basic social skills when I got the chance.

  • I have a friend who was in a gifted program when he was growing up. (They didn't have them when and where I grew up. Hmph.) As I understand it, they effectively took the gifted students and put them into their own school.

    He says it didn't do much academically or in terms of later life, but it did do something he values very much: it gave him a normal childhood.

    According to him, they took the ostracized nerds out of other schools and combined them so that some of them were the jocks of their school, some were the nerds, most were run-of-the-mill students, and so on.

    He's pretty damn smart.

  • As another anecdote, I was in one and do recommend it. Yes, the social isolation is a real thing and you have to work harder to meet other kids outside the program. However, I made lasting friendships with others in the program who remain my closest friends today. I think I covered more ground academically and it set me up well to take advanced classes in middle school. Note, this was in a well-funded public school and over 15 years ago so your mileage may vary.

  • I was in the gifted program in elementary school and it was the absolute best part of school. I was normally completely bored but "horizons" was the only class I got to learn at my own pace, explore what I found interesting, and be with other kids like me.

I doubt the value of gifted programs. All parents innately want their child to be "gifted" but they don't understand what this program really means. They basically just accelerate by full grade or two while raising the expectations for each kid to another level. This is unnecessary burden on kids with a high risk that they can lose confidence or even burn out at tender age not willing to learn anything any more. I think there are probably 1 in 1000 kids who are going to earn PhD by the age of 18. May be gifted program is great for them but for everyone else parents should probably actively avoid them.

  • > They basically just accelerate by full grade or two while raising the expectations for each kid to another level.

    That's...not accurate. Gifted programs tend to increase the degree of personalization more than anything. Yes, most people who qualify for gifted programs at probably going to end up targeting at least a full grade up in each core curriculum area, but the programs don't do a straight bump.

    > This is unnecessary burden on kids with a high risk that they can lose confidence or even burn out at tender age not willing to learn anything any more.

    Gifted programs are actually targeted narrowly at a segment that is more at risk of burning out by being subjected to the unmodified mainstream curriculum.

    > I think there are probably 1 in 1000 kids who are going to earn PhD by the age of 18.

    There pretty clearly are not.

    • I was part of two programs. First from ages about 8 to 12 then another from age 13 to 15.

      The program from 8-12 was what you described. Lots of random subject areas. Programming, history, chess, I learned how to build a mud brick hut (built a scale model and everything). Lots of self direction.

      The program from 13 to 15 wasn't like that. It was more of a straight bump. We approximately did 2 years worth of core curriculum in one year and were then a year ahead for the remainder.

      Unfortunately then at age 16 I and everyone else from that program re-entered the regular classrooms and had to do much of the same year's material again. It was really, really stupid.

      1 reply →

    • My elementary school "GIFTED" program didn't attempt to teach us at a higher grade level at all. Instead it introduced us to different ideas and challenges that normal classes didn't cover. It was everything from an egg-drop contest to programming to creating slides for a report to adopting a manatee to solving "logic problems".

  • That's exactly what some kids need though. Forget about loaded terms like "gifted", some students just pick up the material more quickly and rapidly become bored to tears. Doesn't matter why- are they good at studying? Is the material presented in the way they learn best?- they need to be challenged.

  • I was accelerated by two full grades in primary school when my parents realised that _not_ asking about gifted and talented support was going to cause me mental health issues.

    My family and my school did _not_ raise their expectations of me unreasonably. I quite enjoyed the rest of my school life, where I performed quite well but I certainly did not have perfect grades or come top of every class. Didn't win the dux/valedictorian award in my graduating class of ~30 kids in my rural high school, that went to a regular non-accelerated classmate.

    I don't regret it in the slightest.

    • What "mental health issues" you might have experienced? boredom? You were apparently comfortable working 2 grades above so I'd say you were good fit for those programs. Parents who push their kids in by doing massive prep might get different experience.

      1 reply →

    • How did you get along with your older peers? An age difference of two years is quite a lot in primary school.

  • It depends on the gifted program. I was in one in high school and rather enjoyed it, though it was a pretty wide range of "gifted" (top 10% of my age cohort). I wouldn't characterize my experience as raising the the grade, but rather by diving into different material alongside different people. The material was ostensibly advanced/sophisticated sure, but it was categorically different from what would be encountered in the higher grades at the same "level."

    A friend of mine was in a much more rigorous gifted program (through Stanford) and I think it was the best thing that ever happened to him. He had a very poor home life but he's phenomenally brilliant (he's one of a specific handful of people I've personally met who I use that term for). All he really enjoyed doing from the time he was 12 was reading math and physics books. Going through the gifted program put him on a path that exercised his talents in a way that he found personally very fulfilling. He ended up finishing undergrad at Harvard before the age most kids become sophomores, and then completed a PhD from Harvard before the age most people even begin one.

    Then he went on to work for the NSA and, later, a hedge fund. Those things probably look soulless to a lot of people, but he's very happy.

  • gifted programs in lower income areas are often the only path for decent class rooms that kids there will have.

    The "standard" class rooms are often too interrupted, occasionally by violence. I once saw an 8th grader tackle the hell out of a large administrator. The 8th grader was giant too though.

>>She didn't study for it as recommended by our school district.

Kind of reminds of those fortune telling scams. i.e. The cards that you deal yourself will tell you the future. They tell you not to do it a second time in a row though ( for obvious reasons)

You showed too much respect for something not worthy of respect in my opinion.

That's weird that she was expected to study for it, sounds like it was just testing if she was "ahead of grade level". So yeah, doing it wrong.

When my step kids were tested they were interviewed by a psychologist for a couple of hours and did various IQ and aptitude tests. The report was quite thorough.

  • I mean, you could have a separate "prep test" which is an entirely different purpose and would have to be really super secret on questions and answers including timing.

    Essentially, this checks if you bribed the right people to have the answers for previous tests or even this one, connections and decent enough memory.

    Welcome to America's latest educational scam.

    A test to gauge progress is supposed to be almost fully secret and unpredictable to not bias for people cramming previous answers.

Many school gifted programs follow Mensa requirement of top 2 percentile. I'm not sure the % score was mapped directly to the questions answered correctly.

  • There are somewhat few notable people from MENSA... It is not a great standard for giftedness, more of a smart people club. People who do things are more often than not either too busy to join this club or see no point in it.

    • What I'm reading from your comment is that you have a strong, implicit association between "giftedness" and "notability" - perhaps the latter taking the form of socially recognizable achievement.

      Speaking as someone who was in a gifted program in my youth (and who knew others in more advanced programs), I would like to caution against this perspective. My achievements are not notable, and I would not use that as a heuristic for determining whether or not a particular program/standard is successful or useful. Yet I found my experience to be very positive. Despite the fact that not all programs are created equal, I would generally recommend a suitable one to any parent with a gifted child.

      I understand MENSA is a bit loaded since it can come across as pretentious, so let me reframe the example for you. Take a look at past winners of the Putnam exam. Most of them are not nearly as notable as cperciva[1], but they're all demonstrably gifted.

      Giftedness is not about being entrepreneurial or about how you apply your intelligence in a notable way. Programs designed for gifted people are not trying to create a class of people who are more impressive. In general, they try to foster natural talent in a way that cannot typically be accommodated in the modal classroom setting.

      ________________

      1. For those unaware I'm referring to Colin Percival, an HN user who designed scrypt and developed Tarsnap. He won the Putnam.

    • I guess that means what you mean by 'gifted' or 'notable'. Being very creative, having the confidence to express this creativity and most importantly, being both capable and _willing_ to have a high workload over time is probably correlated to having high IQ, but I strongly doubt that they follow in lockstep. Perseverence and hard work seems to be more correlated to "success" than IQ.

      IMHO there's a lot of smart people that compromise their health and well-being by forcing themselves to work too hard at being notable, and in itself I don't think these are the best objectives to strive for in life.

I took the test in elementary school, and was in the gifted program for almost my entire public school life. I vaguely remember the test, and it doesn't seem like something that could really be studied for - practiced maybe. It was very IQ test like when I took it many years ago. Perhaps it has changed.

You seem to have a bias in this case. Obviously the will accept higher scores before lower scores. It would make no sense to eliminate anyone who scored above 98% based on an assumed “they cheated or trained too much” assertion. Just to include the “addequately but not too good students” who are scoring around 95%, which must be objectively better because that’s where your daughter happened to land. In the alternate reality you would be on here complaining that your daughter didn’t get in even though she had a perfect score and instead a bunch of kids with only 95% got in...

I hate to break it too you, but there’s no conspiracy or broken system, a lot of other kids just scored better than your daughter.

I took the GATE exam in elementary school (which has a similar 98th percentile cutoff) and the test was an absolute joke. Lots of ambiguous pattern matching that I managed to cheese through because I had a decent sense of what the test "wanted" me to put down (FWIW, I didn't end up getting anything out of it, even though I scored in the 99th percentile, because the school closed the program the following year for "lack of funds"). Really: don't read too much into that test.

  • >because I had a decent sense of what the test "wanted" me to put down

    I think this is what they are actually looking for

is the 98% a percentile or a percentage of available marks? In that case it does seem like a poorly designed test. Tests I've seen which are designed to discriminate those at the high end of ability tend to be much harder, not have pass requirements in terms of marks (they may still take the top 2 percent of the curve, but this will correspond to ~75% of available marks instead of the high 90%)

Is the test out of 100%?

I did a maths exam once where the top score possible was 120% (ironic!). The idea was you could ordinarily complete only enough to get 100%, but if you did complete more you got the marks for it.

Why don't they make it harder and differentiate more easily?

  • > I did a maths exam once where the top score possible was 120% (ironic!). The idea was you could ordinarily complete only enough to get 100%, but if you did complete more you got the marks for it.

    Was your test developed by Spın̈al Tap? What is the purpose for doing a test this way?

She may have dodged a bullet - some GATE programs are rubbish, others excellent and it's hard to know what you'll get.

Gifted programs were mostly just designed to segregate white students from minority students.