Comment by scotty79

> SWE-Lancer, built on more than 1,400 software engineering tasks from the freelancer site Upwork

What's not mentioned here (I think) is that tasks in this benchmark are priced and they sum up to million dollars.

And current AIs were able to earn nearly half of that.

So while technically they can't solve most problems (yet) they are already perfectly capable of taking about 40% of the food off your plate.