Comment by MoonGhost
6 months ago
> I'm firmly convinced that being able to troubleshoot code, even code generated by LLMs, and to write guidelines and tests to make sure it's functioning, is a skill of a shrinking pool
Well, today only scientists can make stone tools.
I’m not sure the point you’re trying to make but I’ve had so many junior level interviewees and interactions where they are unable to do anything without an LLM coaching them the whole way. This is dangerous!
It’s like if I was hiring a mathematician. I’d expect them to use a calculator or CAS package but I’d also expect them to be able to do everything by hand. I wouldn’t ever waste their time by making them do that, of course.
> I’m not sure the point you’re trying to make
I was trying to say that dropping old technologies isn't always bad.
> It’s like if I was hiring a mathematician.
Do you expect candidate to memorize all theorems up to date. Usually people forgetting things they don't actively use. But they are able to refresh their knowledge if needed. I've learned quite a lot, but no, I don't remember even key theorems from partial differential equations (used them in my diploma). I can refresh and relearn quickly, I'm sure.
Using LLM without understanding disqualifies the candidate, even monkey can do it. But if he deeply understands the subject and uses LLM for like handbook for minor details.. that's different.
> Do you expect candidate to memorize all theorems up to date.
Completely missing the point. I expect them to have enough knowledge to briefly study the theorems and understand how to apply them. I’m not trying to quiz people, I’m trying to get things done - and done well.
And for the stuff I’m doing, it’s required that any engineer understand what they’re building and why.
> Using LLM without understanding disqualifies the candidate, even monkey can do it. But if he deeply understands the subject and uses LLM for like handbook for minor details.. that's different
The problem is that they don’t understand the subject and overly rely on LLMs. Completely falling apart during in person interviews. Surface knowledge of everything and no depth.
Using LLMs isn’t inherently bad but I’ve seen severe side effects from students and junior engineers who over rely on it.