Comment by cbg0
5 months ago
Is it really valuable data? The task is probably very niche, which is why all models struggle with it and is unlikely to be solvable by a future model without specific training.
5 months ago
Is it really valuable data? The task is probably very niche, which is why all models struggle with it and is unlikely to be solvable by a future model without specific training.
We send the candidates the screening questions in the form of a message that links to a Google Doc so I doubt they ended up in their training data.
Also I don't think our problems are particularly niche, it's completely reasonable that an LLM could solve them (and hopefully will in the future).