Comment by inciampati

The setup in the post plus a speech to text system and aidertmux and aider would be sufficient for a very wide range of tasks. Or a multi screen setup with the phone as a multimodal input system and the AR as the screen.