Comment by westurner
5 months ago
> By mapping model performance to monetary value, we hope SWE-Lancer enables greater research into the economic impact of AI model development.
What could be costed in an upwork or a mechanical turk task Value?
Task Centrality or Blockingness estimation: precedence edges, tsort topological sort, graph metrics like centrality
Task Complexity estimation: story points, planning poker, relative local complexity scales
Task Value estimation: cost/benefit analysis, marginal revenue
No comments yet
Contribute on Hacker News ↗