Comment by tovej
5 days ago
Yes. I usually test AI assistants by giving them my own work to summarize, and have nearly always found errors in their interpretation of the work.
The texts have to be short and high-level for the assistants to have any chance of accurately explaining them.
I can probably process anything short and highlevel by myself in a reasonable time, and if I can’t, I will know, while the LLM will always simulate perfect understanding.