The irrational hungry judge effect revisited (2023)

2 years ago (cambridge.org)

I believe the original studies were shown to be faulty because they didn’t account for the fact that the cases were ordered. Less severe cases were seen first, which meant the more severe cases (ie those with more severe penalties) were shown later.

“Danziger etal. rely crucially on the assumption that the order of the cases is random and, thus, exogenous to the decision-making process. This assumption has been forcefully challenged. For a short and very critical reply in PNAS, Keren Weinshall-Margel and John Shapard analyzed the data of the original study—as well as other self-collected data—and conducted additional interviews with the court personnel involved.Footnote 51 They point out that the order of the cases is not random: The panel tries to deal with all cases from one prison before a break, before then moving to the cases of the next prison after a break. Most importantly, though, requests from prisoners who are not represented by a lawyer are typically dealt with at the end of each session. So, prisoners without legal representation are less likely to receive a favorable decision compared to those with legal representation.Footnote 52 Additionally, lawyers often represent several inmates and decide on the order in which the cases are presented—it might well be possible that they start with the strongest cases”

[1] Chatziathanasiou, K., 2022. Beware the lure of narratives:“hungry judges” should not motivate the use of “artificial intelligence” in law. German Law Journal, 23(4), pp.452-464.

  • > the fact that the cases were ordered. Less severe cases were seen first, which meant the more severe cases (ie those with more severe penalties) were shown later.

    Isn't that order creating a bias for the judge? Should the cases be randomized instead?

    • Yes, in the words of the linked paper it injects exogenous decision making. In other words, the decision is based on more than just the judge so we can’t conclude the discrepancy is due to the judge’s personal bias.

      14 replies →

    • >> Should the cases be randomized instead?

      Like any other set of tasks, the order is a practical matter. Severe cases are more random, sometimes sucking up more time than expected. Put them early in the order and any delay will impact everyone. So judges try to get the easy/predictable stuff done first, minimizing the number of people impacted by the inevitable delays. (Doctors do the same if they can, trying tk see easy patients first.)

      Also, as with any other process, you want to start with a few easy wins in order to solve inevitable problems. If there is something wrong with the court tech (recorders, security etc) you can work it out during the easy cases. Save the murders for after everything is sorted.

      Thirdly, prisoners are different than normal people. They do not control thier own scheduals. Put thier case early in the docket and they might miss breakfast at the jail. Prisoners are also moved as groups. Put them randomly on the docket and they all have to wait all day. Put them as a group towards the end and the group wont wait as long. So cases involving prisoners, on average the more severe cases, are placed later on the docket.

    • I wonder if this butts up against the fourth and fifteenth amendments, which touch on due process and justice not being delayed unnecessarily.

      Randomness introduces inefficiency which implies delay

      25 replies →

This is fascinating.

For those unfamiliar, the original study found that judges were kinder in their decisions right after lunch, and harshest right before. (I’m dramatically oversimplifying, but that’s the bit folks usually cite.)

This study contests the strength of that finding by showing that positive rulings take longer, and that you can fit more simple negative rulings in just before a break (negative rulings are denials of parole, if you’re wondering why they are faster). Judges don’t want to start complex cases that are more likely to be favorable just before break. (Again, dramatically simplifying. The article has more.)

I have cited the original study countless times, and this injects a lot more nuance for me. I’m glad it was revisited.

  • Coming from a psychology major myself, scientific studies should never be cited before being reproduced, especially not psychology studies.

    • Without having read in-depth either original paper, it seems like the issue here is much simpler than reproduction (though reproduction is the gold standard as is totally under-appreciated these days).

      Rather, it seems the authors made a much simpler mistake: hypotheses can only be refuted by evidence, not confirmed. So, in this case, if the hypothesis is "judges act more harshly when hungry", what they should have been doing is looking for evidence disproving that statement. Instead, they seem to have presented a correlation and a suggestion, which is not the same thing as a scientific finding.

  • There was another article related to this study that hit the HN front page. It talked about the size of effect, and argued that the effect size was ridiculously big, and if true, we should see giant spikes in car crashes around lunch, big enough for common sense to ban driving just before noon.

    I think you'll enjoy the read.

    > If hunger had an effect on our mental resources of this magnitude, our society would fall into minor chaos every day at 11:45. Or at the very least, our society would have organized itself around this incredibly strong effect of mental depletion.

    https://daniellakens.blogspot.com/2017/07/impossibly-hungry-...

  • Did anybody ever ask the judges/clerks about this finding? It seems like the whole thing could have been rebutted with one phone call and the judge saying “yeah, we make the schedules and intentionally backload the negative/easy ones”

    • They have incentive to hide it. Ordinary people want to think the justice system actually does justice. Not group cases by time slot because they are likely to be simply denied, which is clearly biased.

      Personally this is more disturbing to me than the alleged earlier finding that the judge was in a bad mood because he was hungry. At least that is correctable and avoidable; systemic discrimination by case type isn't.

      4 replies →

Statistics for stuff that has unequal length is tricky. Reminds me of the days there I did packet sampling on the LAN and as the length distribution is bimodal statistical math using means as assumption yielded misleading results.

Interesting, didn't see this before. Now I am curious about addicted judge effect (e.g. smoking) since I witnessed weird things semi-similar to this, but for smoking.

  • Not to mention how different vices are going to affect a judge differently. One addicted to the lunchtime brothel might rule different than one addicted to the lunchtime smoke, and different still to one addicted to the lunchtime scotch.

Study finds that when there's a time limit, even a rational judge would try the case faster, and there would be a tendency towards unfavorable ruling.

Since lunchtime (and presumably end of work day) are such time limits, we see a drop in favorable rulings as lunchtime approaches, and a restoration in favorable rulings right after lunchtime.

And yet, the study, curiously, says, "the analyses by DLA do not provide conclusive evidence for the hypothesis that extraneous factors influence legal rulings". What is lunchtime and end of work day as not extraneous factors?

Note: the above only explains a part of the original finding. And the study admits that there are definitely more factors at play.

  • > Study finds that when there's a time limit, even a rational judge would try the case faster, and there would be a tendency towards unfavorable ruling.

    This study does not say this.

    The simulated rational judges are "ideal" and their decisions are not influenced by the ordering of the cases or how long it has been since a break.

    The study is saying that despite this perfect behavior, some simulated methods for choosing when to take a break will cause favorable cases to be more likely to be scheduled at the beginning of a session (in their last simulation, this effect only appears after applying the same statistical processing as the original study).

I have not been scheduling any meetings before lunch for years after I read the original study. oops

  • Better strategy: Make sure to have no meetings with a judge.

    More seriously: I do the opposite, makes sure people don't deviate (due to hunger) and doesn't split my morning in two discontinuous blocks.

  • I mean, fewer meetings is fine.. unless you were staying late to do the same number of meetings.

It would be interesting to see comparison where the default outcome is the opposite.

The prisoner is in prison and will continue to be in prison.

So might the outcome be different if the prisoner was doing to be set free unless judges argued why he was still going to be in prisoned.

It's probably way complicated though.

When was the last time a judge got fired for bad perforomance or being biased. Funny how judges somehow never face consequences of doing their jobs really poorly. They'll grant immunity for themselves. It's like a mafia...protect their own.

  • Even if judges don't suffer punishment for bad performance, they do suffer personal discomfort from poor meal planning. Most judges most days will be following their usual eating routine which will have them feeling fine before lunch. People become notably irritable when they miss a meal, not before meals when they're eating normally.

This day and age if a social/psych “paper” defies common sense it should just be ignored. Pushing these “findings” as science should be considered malpractice.

  • Perhaps, but the original paper (harsher sentences before lunch) does not defy "common sense." Common sense tells people that when they are hungry, they are irritable. Many people are familiar with the concept of feeling "hangry."

    See https://health.clevelandclinic.org/is-being-hangry-really-a-...

    • Sure that’s why it’s plausible but it defies common sense to assume that judges are not managing their own hunger to the extent that it’s affecting their job performance.

      Why wouldn’t surgeons or pilots have the same problem?

      The paper is sensational because of the implications it has for the social justice causes certain people are obsessed about.

      15 replies →

    • It's unusual for people to experience mentally distracting hunger pangs before lunch on a regular basis, because people tend to eat larger dinners and/or breakfasts to get them to lunch without significant discomfort. Debilitating hunger is an unusual experience that comes from skipping meals for some unusual reason, a break in somebody's normal routine.

    • Similarly, I had a manager who used to try to push stuff in right at the end of pre-lunch meetings when everyone just wanted to get out of there.

  • I think that’s a little far — mainly the point where science itself is often a rejection of things that were previously called “common sense”.

    But this can also be expanded. There are no fields of science where a singular paper should be widely accepted before replication and additional studies.

    Social sciences have a noticeable issue where they lend themselves to dramatic headlines and over extrapolation I suspect that this is largely an aspect of them being much more understandable and ultimately relatable than some of the more niche fields where papers address nearly unapproachable topics

    • > There are no fields of science where a singular paper should be widely accepted before replication and additional studies.

      Certainly within mathematics, this isn't a requirement, and I think the same holds within some branches of theoretical physics, as well as computing science.

      I suppose there's a decent argument to be made that these things aren't "Science". Certainly, mathematics uses something different from the empirical method to progress knowledge. But there isn't really a good alternative word.

  • Hungry people are cranky, and cranky people are less fair to others, are both only common sense.

  • Why does this paper defy common sense?

    • That the effect is so large should draw a lot of suspicion. Real psychological effects almost never have that magnitude.

      The claim that heavily vetted, highly educated judges are reliably just throwing out punishments willy-nilly because they want a snack is also quite suspect, especially as there is no reason to expect this to only work in one direction- why wouldn't they be just as willing to let people off easy when that gets them to lunch just as quickly?

      4 replies →

  • Blood sugar affects mood. A person's decision-making can be affected by mood. Judges make decisions. Seems pretty common sense to me.

    It may not change guilty/not-guilty verdicts but it's easy to believe that perhaps it would affect milder differences.

    • > Seems pretty common sense to me.

      It’s also seems like it’d be commonsense for judges to know that and have meal and snack strategies to account for it. To determine what the real effect is then you need to establish it empirically and they haven’t.

      1 reply →

  • Judging yesterday's findings with today's information is never fair.

    Should Galileo be punished for malpractice because he thought tides were related to the sun?

Could this not also be evidence for bias?

A judge scheduling longer hearings for cases with good outcomes suggests they've already made up their mind.

  • Once you are an expert at any topic, you can figure many outcomes from very small amounts of information. That does not mean the outcome was biased or flawed etc.

    Is it difficult to believe that a judge would be able to predict at least some outcomes from a single paragraph?

    All it takes is to predict above random chance to have a statistically significant effect.

    • This reads almost verbatim as my conception of bias.

      "Once you've abandoned principled, wholistic reasoning for your pet heuristics, you can figure out many outcomes from the inputs to your pet heuristics".

      Do you mean something different by "bias"?

      4 replies →

    • Developing that sort of expertise requires getting clear and—ideally—timely feedback on the quality of your decisions. Do parole judges get that?

      I'm sure they get feedback on whether their decisions are consistent with what other judges would have decided, but that's qualitatively different from feedback on whether those decisions were fair or right. If anything, that is the kind of feedback that would propagate biases in the system! You would end up becoming an expert on making consistent, defensible decisions, even if those decisions were consistently and defensibly bad.

      1 reply →

    • > Is it difficult to believe that a judge would be able to predict at least some outcomes from a single paragraph?

      It's difficult to believe that the decision should be made quickly. When making decisions about the trajectory of someone's life, they should be made with care. Having a system that removes snap judgements and bias is important, and I would say that even a quick-scan and re-ordering of documents is a form of bias.

      4 replies →

As someone said in an article about detecting bullshit science research, if such an effect were true, every day at noon tragedies and accidents would happen all over the world, and we would live in a different world where work close to lunch was illegal and so on, just like we forbid work under alcohol.

  • Lead was added to gasoline since the 1920s. The first clinical studies that showed it was toxic were in 1969. The first country to ban it completely was Japan in 1986 and the last was Algeria in 2021. For more than a decade, people could have made a similar claim to yours, "if such an effect were true, we would have banned it already". And they would have been wrong, the effect was true.

    • > The first clinical studies that showed it was toxic were in 1969.

      We knew it was dangerous within a year of it being introduced, even if we didn't publish widespread clinical studies before the 60s. Its creator, Thomas Midgley Jr, was diagnosed with lead poisoning multiple times.

      > Warnings about the toxicity of tetraethyllead came to Midgley from various sources. The letter of Erich Krause concerning its toxic effects, quoted in part in part 1,2 written on November 30, 1922, to George Calingaert (then at M.I.T.) was forwarded to Midgley in December 1922 by W. G. Whitman, Assistant Director of the M.I.T. Research Laboratory of Applied Chemistry. However, despite his own health problems and these early warnings, Midgley did not appear to be overly concerned about the health issues associated with the handling and use of tetraethyllead.

      https://pubs.acs.org/doi/10.1021/om030621b

      There's also some discussion at https://en.wikipedia.org/wiki/Tetraethyllead#Initial_controv... suggesting that early studies may have been suppressed by the lead industry.

      > In the years that followed, research was heavily funded by the lead industry; in 1943, Randolph Byers found children with lead poisoning had behavior problems, but the Lead Industries Association threatened him with a lawsuit and the research ended.

    • > Lead was added to gasoline since the 1920s...the last was Algeria in 2021.

      Right, so we figure these things out within 100 years or so at most. We've been dealing with hunger for millions of years, you'd expect there to be something in the Torah about how no man shall act as a judge before he's had lunch.

      1 reply →

  • > and accidents would happen all over the world, and we would live in a different world where work close to lunch was illegal and so on,

    Not at all, as a society ee are really good at ignoring terrible consequences of our decisions and carrying on regardless, sometimes for no reason other than habit.

    We force children to go to school early despite mountains of evidence that this harms their learning, we give antibiotics to healthy livestock despite absolute proof that this causes antibiotic resistance, you can probably add more to this list, I.e climate change, etc.

    • Nassim Taleb has a theory that the primary purpose of school is not to educate children, but to keep them from roaming the streets and causing mayhem. Learning is a side-effect.

      8 replies →

  • It's funny that no one's understanding your claim.

    The effect size claimed for the original paper, as well as how obvious and localised the effect is, would make it incredibly obvious to observe. Thus if this effect were true, we would have to explain how we've all missed it.

    This is not comparable to long-term effects, or ones otherwise difficult to notice, etc. We notice the effects of alcohol immediately, and here, it's claimed being hungry-for-lunch is at least as large, if not larger, effect.

    This seems obvious nonsense. If any other statistical model can explain the same effect, it's vastly more likely, since it benefits from not making a miracle out of our missing the lethality of mild lunchtime hunger.

  • > just like we forbid work under alcohol

    Do we? In many companies there is free infinite beer

Interesting to think that in hunger evolution chose to increase the noise (irrationality) in our system, and that actually worked to make us more likely to survive (*in aggregate, statistically).

I guess the pithy aphorism: fortune favors the brave. Make a decision, even in limited information, you'll be better off than if you didn't.

Strange confirmation of the nature of reality from the human/experiment computation that is evolution. Hahaha! :)

  • Is it confirmed that this effect is “intentional” by evolution? Couldn’t this also just be a side effect of how the brain works which wasn’t negative enough to evolve a defense against? Maybe the neurons becoming less reliable when having too little sugar for example?

    • Sure, but hard to argue there's not some advantage as well, even to traits that operate unadaptively in some situations, so evolution likely played a role.

      More important that evolutionary argument is we all know how increasing the noise unfurls the decision tree into more possibilities, which seems undeniably adaptive by fanning out the search space.

      You have to consdier the en masse effect, not just the obvious, "in this 1 instance it was bad." Overall, a mode where you switch to a wider search strategy (like turning up the heat in an LLM) can be what you need...to procreate (eventually) hahaha! :)

    • It might be a similar stressor like performing a task with a full bladder. there's definitely something that negatively impacts your cognition and you'll be more likely to refuse complexity to 'get it over with' whatever that means for the ruling of a court.

      6 replies →

  • Works in games too, if you're in a worse situation and almost guaranteed to lose with standard strategies, might as well try high-risk/high-reward strategies instead (since you need enough "reward" to overcome the difference and the risk doesn't matter).

  • If you're hungry, surely the evolutionarily 'rational' action is to prioritise eating. That seems to be what's happening, certainly for those lucky enough to be able to control who eats and when.

    • Maybe. But judges are also disciplined and anally retentive. Gratification delayers. I can imagine many of them just want to get it done, then eat. May even be a cerebral-overemphasis leading to lack of body awareness. So for them, the rational action would be complete work, then eat (if time haha :)).

      But I guess you meant more generally in evolution. Yes, but the question is how does the body prioritize eating in situations where food is not available but hunger is? If food is not obvious, it must be sought. Increase the noise in the search algorithm, would seem to maximize state space exploration in food quest, which seems something evolution would then pass on.

      Better than cargo culting anyway hahaha! :)

  • It's easy to propose a different explanation: brain consumes a lot of energy, and in hunger it makes sense to run it in a sort of simplified economode to avoid risk of shutting down completely. It doesn't mean that going into less rational state increases survivability vs more rational one, it does however when compared to lying down unconscious because sugar is too low to support full throttle run

    • I didn't totally get your last phrase on the comparison (I think you mean we evolved less rational low power state on low food to conserve energy for when we need it more, because low power but operational is more survivable than passing out due to hunger - did I get you right?), but this is a good counter. How could we test between them? It's possible it's /both, but without a good experiment hard to say. Hypothesis 1: brain on low sugar, increases variance in problem solving. Hypothesis 2: brain on low sugar low power mode prioritizes simpler solutions (I think I got you?). Your point is a good counter to mine, but I think the qualifier is that in low food situation, a less rational state is a more effective search algorithm to find key resources, than a more rational one (with definition of rational tempered by what is achievable passing as rational for most humans in aggregate). But maybe we are getting too complex for a hn comment when we might not be running the experiemnt oursleves hahaha :)

  • You can’t glean insight about evolution from this. Hunger doesn’t follow a steady rate of making you irrational or whatever else. People who are used to it can go 18 hours without eating just fine. In fact they might report that it makes them sharper. While other people get “hangry” if they don’t eat every four hours.

    • This is a fair point about different conditioning to hunger, which to some extent, we are all capable of attaining. Those responses you mention do seem like evolutionary adaptations themselves, which may nevertheless vary across individuals. Such as ketolysis making people sharper mentally, which I've certainly experienced.

      Your point about that making it hard to tell what evolution may have wanted from this, given such variety, is fair. However it's not necessarily a point against an evolutionary trend here, just because responses are varied. There could be adaptiveness, in aggregate (as it always is in these considerations I think), to having some people express different responses.

      I think this stressor is ripe for gleaning insight about evolution, tho. Because of how critical food is. And therefore how much effective ways to overcome food loss would have been critical for evolution to hack at. It's likely evolution has laid out a series of algorithms for us, depending on what stage of hunger we are at - each developed to be the most effective balance at that stage between resource usage, and search success.

      In that sense the different modes you describe "hangry" and "hunglightened" (and possibly some more in between) are most likely evolutionarily designed "behavior algorithms" that each maximize adaptiveness for finding food and surviving at each stage of progression towards starvation.

      I really think you should think more about it, because how could it be any other way? Food is so crucial, evo is obviously going to get right into how we react to its absence.

      Of course if your point is more about difficulty in concluding from the paucity of data in this discussion, I'm all with you! We are just hypothesising now, which is perfectly valid. And, for me at least, insightful. I feel truly sorry for you, that you didn't find it that! :)

      I'd like to end with this weird little side-note counter: another pithy aphorism about food and performance: never make any big decision on an empty stomach! Hahaha! :) Many have said that.

      1 reply →

  • I’m not sure this study does anything to show that hunger increases irrationality. If anything, the authors point to rational, predictive decision-making right before meal time.

    Do you see something that indicates increased irrationality?

    • Honestly I was responding to the title which suggests that "irrational hungry judge" is a thing. If it is not, I revise all my ideas hahaah! :)

      But then again, we must question a study that questions a proceeding one and so on. I'm not getting into the weeds of it to do that right now, just speculatin :)

      What did you see about it that counters the "irrational hungry judge effect"?

      2 replies →

I tell this to everyone: be wary of hypotheses and results that are very appealing.

In sum, the effect is explained by scheduling easy-to-judge cases to the time limited AM session, and the complex cases to the longer PM session.

So you're saying that another pop-sci psychology result turned out to be fundamentally flawed? I never would have guessed!

Anyway, I'll keep citing it as if it was legit, and be smug about it.