Comment by n4r9

Imo the counter-argument is that in principle you can research and understand the mechanics of climate change or medicine. You just don't have the free time and/or the motivation. With AI that changes - you could spend your entire life trying in vain to understand its reasoning.

It reminds me of how some religious people say that science is effectively no different to religion because we all take expert opinions on faith. But the difference is that there is a well-defined pathway to understanding, if you wish to do so.