Comment by pictureofabear

I think the problem with AI asking questions is that it will ask questions that are interesting to it but not necessarily us. AI, as a model, will never be a perfect copy of a human. It will always be a simulation, and thus to some extent, will ask questions that humans find irrelevant and solve problems that humans find irrelevant.

For anyone facing an existential crisis on AI, your ace in the hole is your humanity. Only you have it, and only you will be the best judge of what is good and interesting (to a human at least).