Comment by dijit

1 day ago

“put substantial effort into it” is such a personal thing.

DDG hires like this, actually, and if I recall correctly I would be paid a flat fee, it would take a week, and the work I did would be part of something genuine in DDG, maybe a bug or something.

Now, that probably sounds good to you, but taking a week out of my current employment is not going to happen- there’s an incentive to go “over the hours” inherent to the ask, even if you’re paying me a flat rate, I might lose to someone equally qualified who puts in 1.01n into the task, so I should put 1.02n (etc; ad infinitum).

Which is part of the issue with all take home assignments. I have given out take home assignments (given to HR to be administered) which should take a qualified candidate 20 minutes to finish beginning to end (as in, including syncing the project, setting up their editor, exploring the problem, googling around about things, trying it out and then following up with the email to HR). I don’t doubt for even a moment that someone has spent several hours on this problem- because they’re not qualified.

Passing the HR barrier in that case will not help them unfortunately, because they’ll get to talk to me, and I will disqualify them in all likelihood, and candidates are told that it should take not more than a half hour, but en masse: people don’t listen.

The trouble is, theres thousands of applicants, a handful of HR, and one me.

Not to be on some kind of pedestal (I’m not), but the problem doesn’t scale, you need only apply the tiniest amount of systems thinking to see it.

Thousands of applicants reaching the substantial work stage is a failure of the systems thinking you're talking about. Hundreds of resumes nearly always gets narrowed down to perhaps a dozen or two at most at the screening stage.

And I would make it very clear that putting in more than 30 minutes of work, timed, is a disqualifier, and I would sleep well at night clearing all those people out of the queue.

  • Hundreds of good applicants can’t be whittled down to a dozen without being very picky about things in the resume which may just be a poor representation.

    You will bias heavily along some kind of axis, preferred previous employers or location, age, etc.

    You add a lot of bias into the system by trying to further scrutinise otherwise meaningfully qualified people on paper.

    • As long as you aren’t biasing for any protected classes, why does it matter? If you as an employer have found that graduates from Foo University is a generally positive signal, then why wouldn’t you bias for that, if it’s saving you significant time, and introducing minimal false positives?

    • Yes, people don’t realize that’s why a lot of desirable jobs/grad schools become filled with people from top universities and previous employment. Pedigree is probably the lowest hanging fruit when it comes to shaving off a good chuck of applicants to a level that at least you know would be adequate.

      3 replies →

    • Once again, you're misunderstanding the goal of the system if you think that it's necessary to deliberately whittle down hundreds of good applicants through careful process to get a great hire.

      Hint: you don't even need to evaluate most candidates at all. Random sampling is sufficient and provably bias free.

      2 replies →

>should take a qualified candidate 20 minutes to finish beginning to end (as in, including syncing the project, setting up their editor, exploring the problem, googling around about things, trying it out and then following up with the email to HR

So about six minutes for the problem itself, then?