Comment by xyzzy123

Right. What I not sure about - even for builders - even when the results are technically verifiable, the details can still matter. AI is really good at proving or building a slightly different thing than you thought you asked for, and if you're not at a level where you can understand key details of the formalisation of your ask, you cannot safely use the results.

Without human understanding you also might literally have no words for the thing you would otherwise want to ask for.

I think it'll be wildy useful but I also suspect human competence will still matter.