Comment by dotancohen
10 hours ago
I'd you have some tips for coming up with such tests, I would love to hear them. My Gmail username is the same as my HN username. Thank you!
10 hours ago
I'd you have some tips for coming up with such tests, I would love to hear them. My Gmail username is the same as my HN username. Thank you!
It's actually just a coding interview test that I liked to ask in the past. You can find it and others on leetcode.
The reason I personally like my question is because it's pretty close to some of the real world work we do. It's mostly mundane and easy to bang out, but really easy for someone to do a n log n solution where an n solution exists.
A good example (but not my question) would be something like
"I have a list of People objects with a `first` and `last` name. Write a function which groups together all the People with the same last name in `your language of choice`"
LLMs have a problem with that type of question? I might try it later at home.
Now a days? No. It's actually getting to be a bad question because they all push out about the exact same answer.
But much earlier they did and, apparently, these really small models still do. At this point it serves as more of a smoke test for me. Success means little, failure means a lot.
1 reply →