Comment by abeppu

But the thing in the study cited in the post was putting people alone in a room for the same task with the same time limit -- _not_ take home assignments.

What if this is just a (labor-saving) tweak to on-site live coding interviews. You've already reserved the room. The status quo is that a member of technical staff is in the room with the candidate for the duration of their interview. The low-cost alteration is, after you explain the task and make sure it's clear, you leave them alone in there for the remainder of the period. Perhaps the interviewer gets a few small work tasks done while waiting outside.

I think the only unfortunate thing is that when you're in the room trying to talk to them about their solution as they write it, sometimes you can have a helpful discussion, which may involve probing or leading questions, which sometimes give you some signal -- but these also make it much more difficult to compare across candidates, so perhaps we should be ok letting go of that opportunity.