Comment by jboggan

"Even more telling was that we couldn’t discern any pattern to predict which tasks would work."

I think this cuts to the core of the problem for having a human in the loop. If we cannot learn how to best use the tool from repeated use and discern some kind of patterns of best and worst practices then it isn't really a tool.