Comment by ehnto
3 months ago
I need to be delicate with wording here, but this is why it's a worry that all the least intelligent people you know could be using AI.
It's why non-coders think it's doing an amazing job at software.
But it's worryingly why using it for research, where you necessarily don't know what you don't know, is going to trip up even smarter people.
You are describing exactly the Dunning-Kruger Effect[0] in action. I’ve worked with some very bright yet less technical people who think the output is some sort of magic lamp and vastly overindex on it. It’s very hard as an engineer to explain this to them.
[0] https://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect