Comment by sullyj3

I see your point, but relative capability levels aren't the only relevant factor here, absolute capabilities matter as well.

It seems plausible to me that even if we are to the AI as cats are to us, we've reached an absolute threshold of generality that allows the AI to be confident in our ability to follow simple (to it) instructions, in a way that cats can't for us.