← Back to context

Comment by sceptic123

3 hours ago

So basically "one-shot <complicated thing> using <x> testing methodology".

I don't think that's a very effective test of an agents ability.

It's intended as a "test to see how effective agents are when guided by someone with no expertise in testing who's maybe heard that you should apply certain techniques or use certain libraries." What do you think would be a more effective test for that purpose?