Comment by pera

My point was that we won't care about benchmarks anymore because we would see an obvious and completely unprecedent increase in productivity (and I believe it will likely come from the same people who will develope such machine).

The reason most of the conversations are focused on benchmarks is because we are still in the age of weak AI.