Comment by scoot

3 days ago

> Donkey Vision — a screen-understanding API that turns any screenshot into structured, clickable UI, so you can build computer-use tools of your own.

Not faulting your (necessary given today's reality) work, but sad to think that the Amiga still remains ahead of it's time some 36 years later (since ARexx was bundle with the OS), or closer to 40 years if you count when v1 was released separately.

ARexx allowed any application that supported it (and most productivity apps worth their salt did) to communicate with each other, and to be scripted - essentially a standardised API for applications.

We're slowly getting there (at least for SaaS apps) with MCP, but screen scraping shouldn't ever have been necessary.