Comment by seydor

3 years ago

Well it s good, this is how you make something that turns us to cyborgs.

A bit pricey to become a household items (because a family needs 4 of them) but this is probably where things are heading to

There is so much engineering going on here that maybe ... it's simpler to start considering retina implants or just brain implants.

This was more like a work of art than a consumer device. I wonder if Oculus can steal some ideas ... Like, these device are not for gaming but general productivity. Ditch the 2 oculus controllers, put the battery in the 1 controller and wire it to the head. I m not convinced if eye tracking is worth it. oculus' controls are precise enough and in any case it's better to hold something instead of pointing and pinching the air, it makes the device more physical. dont know what is needed for the ability to render a full field of view but would be interesting to know what is the level of nausea this causes when movement is involved. I guess Apple purposely chose to eliminate all optic flow movement - all the apps appear to be stationary.

Their cost comparison to a 4k tv, surround sound, high end laptop, etc does seem reasonable for a single person, but it does indeed break down for a family. Everyone sitting on the couch watching a movie, but you with your goggles getting a completely different experience.

  • > 4k tv, surround sound, high end laptop

    None of those can be replaced by a vr headset in anything but "some" applications and scenarios.

    • Yeah, how exactly are you replacing a laptop with something without a keyboard? A tablet perhaps, but we're miles away from this one still.

  • Notably there doesn't seem to be any tech present to share virtual spaces at all. All these smiling people staring at their virtual screens couldnt even share their experiences if they wanted to & everyone else had a Vision Pro too. These are personal, pocket spaces.

    There was notably no effort to do a MagicLeap either, of playing with existing space. Meta for example shows people enjoying a crazy dungeon crawler board game atop their real table; very primitive but something physically integrated. I didn't see a single example of Apple integrating with space, only taking it over.

Sony's VR headset also has eye tracking.

It is a great input, but more importantly: drastically lowers the required computation with foviated rendering, i.e. rendering hires where you look, not everywhere.

  • Unless you’re doing at least once over 100Hz refresh rates, human eyeballs are too fast for foveated rendering. Motion to photon latency for this thing is 12ms from the presentation, which is 83Hz(so it’s 85Hz), and that’s probably for post-processing 2D warping and not 3D scene shading/rendering where foveated rendering must take place so no way that works.

    • They did specifically mention foveated rendering.

      Also the 12ms mentioned, wasn't that from camera to screen (so the latency of both the camera sensor added to the latency of the screen) or did i misunderstand?

      Now that i think about it, the eye tracking is also a camera. Hmm.

I’m convinced it’s not possible to build a decent headset without eye tracking. Low latency, high refresh rates, massive resolutions, in a tiny footprint just isn’t possible with our current generation of chips. Eye tracking lets you put your compute cycles where they’re needed, and not waste time rendering to useless pixels.

  • is it really low latency considering that it needs 2 cameras and a bunch of leds? Also, saccades are not very precise and are relatively small movement so i m nor sure how precise and detailed the pointer is in these.

    • The said during the event that they have a custom chip to do the signal processing for the cameras and sensors. I fully believe they’ve solved the camera latency issue.