Comment by what

3 hours ago

Why are you asking an LLM what could have been better or was confusing? It literally has no idea.

True. But it has no idea that it has no idea, so it might be able to look back at the session trace and pattern match its way to actionable feedback?

If they try something and it doesn't work and they then try something else and it DOES work that's concrete feedback.

they're surprising good at this. The next tokens after a confusing string of tokens when asked to explain the confusing parts are pretty accurate!