Comment by koliber
2 years ago
I recruit senior Java developers. The are so many parallels.
They don’t read instructions. Instructions say clearly not to use ai for the written screen.
They copy and paste blindly. The trick is that there are some instructions written in 0-sizes font that people don’t see in the assignment description. The copied-and-pasted version has them but no one rereads the prompt.
Also the AI gives a substandard answer, but that’s besides the point.
The better test I saw was here's the prompt, here's what ChatGPT produced. What's wrong with it, why, and how would you fix it?
I like that!
What if they use AI but the right way to get the correct answer? What then? Maybe asking candidates something an AI can also answer is not the right way to screen people.
I want people to use ai on the job. To use it effectively you need to be at a certain level so you can correct the ai. That’s why I ask people not to use ai.
Additionally, and more importantly, trust is important. If you violate it by ignoring a trivial but prominent ask it sets the wrong foundation for a potential working relationship.
If they use it the right way, then you wouldn't be able to tell.
That's my point. He told candidates not to use AI. What's the point of saying that if candidates can use AI without getting caught?
5 replies →
> written in 0-sizes font
You're... evil.
I love it.
Unfortunately since it's not visible, a unscrupulous motivated candidate will just give an LVM an image of the prompt, let it OCR it, and then pass on its answer. OCRing it also defends against prompt injection with white text on a white background.
A motivated, careful, vigilant candidate will do that and I won't be able to tell.
I look for motivated, careful, and vigilant candidates so if they do it and I can't tell, I am OK with it.
Most are not motivated, careful, and vigilant.
Most are careless, don't pay attention to details, and look for shortcuts.