Comment by vineyardmike

14 hours ago

No.

Computer use (to anthropic, as in the article) is an LLM controlling a computer via a video feed of the display, and controlling it with the mouse and keyboard.

9 comments

vineyardmike

Reply
jebus989  2 hours ago

Even simpler it just takes screenshots (or at least that's what it was doing last time I used it)

dbbk  13 hours ago

That sounds weird. Why does it need a video feed? The computer can already generate an accessibility tree, same as Playwright uses it for webpages.

  • lsaferite  12 hours ago

    I feel like a legion of blind computer users could attest to how bad accessibility is online. If you added AI Agents to the users of accessibility features you might even see a purposeful regression in the space.

chasd00  13 hours ago

> controlling a computer via a video feed of the display, and controlling it with the mouse and keyboard.

I guess that's one way to get around robots.txt. Claim that you would respect it but since the bot is not technically a crawler it doesn't apply. It's also an easier sell to not identify the bot in the user agent string because, hey, it's not a script, it's using the computer like a human would!