Comment by why_at
3 days ago
I get that LLMs are a black box in ways that most other technologies aren't. It still feels to me like they have to be okay with abstracting out some of the details of how things work.
Unless they have a lot of knowledge in electrical engineering/optics, the average user of this isn't going to understand how the camera or projector work except at a very high level.
I feel like the problem with LLMs here is more that they are not very predictable in their output and can fail in unexpected ways that are hard to resolve. You can rely on the camera to output some bits corresponding to whatever you're pointing it at even if you don't know anything about its internals.
Building projection optics is a bench top experiment that we did in 7th grade in school. Electric circuitry isn't exactly rocket science, either. Things like LCD panels for projecting arbitrary images and CCD chips for cameras become harder to understand.
But the point is to make users understand the system enough to instill the confidence to change things and explore further. This is important because the true power of computer systems comes from their flexibility and malleability.
You can never build that level of confidence with LLMs.