Comment by quinnjh

14 days ago

> There's some early exploration of using accessibility APIs to empower LLM's.

any examples come to mind?

4 comments

quinnjh

Reply
simonw  14 days ago

The popular Playwright MCP uses the Chrome accessibility tree to help agents navigate websites: https://github.com/microsoft/playwright/blob/ed176022a63add8...

  • wincy  14 days ago

    I tried to have Cursor use the playwright MCP to click a few buttons on my project as a test and while it did do what I asked successfully, it burned through like 150 premium requests in 5 minutes.

    I guess if you’re totally insensitive to the cost you can use this.

  • quinnjh  13 days ago

    thanks, somehow have used this and also been working in a11y and didnt put 2 and 2 together that its the same tech