Comment by nitwit005
21 hours ago
> to improve the company's models in areas where they still struggle, like choosing from dropdown menus and using keyboard shortcuts
Seems like a strange approach in general. I'd have assumed you'd just have it use accessibility features to get at things, if there is no other interface.
Knowing how to make an accessible website is so rare that companies pay me money to do it for them. I wish it was good enough for people, much less companies, to rely on.
Even if no attempt at proper accessibility was made, it's still generally far easier to attempt to find an HTML (or other form of UI) element, than to attempt to scroll to the right spot and use visual inspection to find things.
a CLI with a man page should already be usable by an LLM.