Comment by everforward
12 hours ago
> For that to be made stable, you really need a whole 3D model of the scene, and the cost increase there might be huge.
I suspect it is, because the 2D -> 3D models I've seen are terrible, but more importantly the 2D -> 3d models are terrible. Noteworthy because I suspect the number of people who have 3D scans laying around is tiny.
What you're describing is vaguely how video games work, to my understanding. There may be interesting parallels if that becomes a technique (like how distant objects are sometimes still rendered, but at a lower resolution/polygon count).
> What you're describing is vaguely how video games work, to my understanding.
Your understanding is broadly correct. There is a 3D world, and the GPU computes how it looks like from a particular viewpoint.
In essence, objects are painted back to front, so that in the final image every pixel shows the nearest visible object. The details get complicated, but the idea is simple.