Comment by Animats
7 years ago
Well, yes. Ever since the old SGI 3D file browser [1], a true 3D interface approach has been terrible. Tilt Brush is probably the best success so far.[2] Even that, though, isn't very good for artistic work. It's just finger-painting in 3D.
Without force feedback, human positioning in 3D space is terrible. Maybe if we get usable VR gloves with force feedback, so you can grab a knob or lever and feel the movement, stops, and detents, it could be workable.
Check out this Smarter Every Day introduction to the HaptX force feedback glove from last year.[1] The guy thought VR was stupid until he used the glove, then was instantly immersed. They’ve packed a lot of sensory feedback into it.
Once force feedback hits, translating 2D onscreen control surfaces to 3D models will be both trivial and worthwhile, at least in the niche realm of virtual audio devices. Touchscreens have already made them much more playable, and things like TouchOSC allow for some customization. I’d love to have something like the Reason rack[2] in a space where I could use all 10 fingers instead of 1 mouse pointer to interact with it.
[1] https://youtu.be/OK2y4Z5IkZ0
[2] https://images.app.goo.gl/37FMUZ6kfgTb5rPf6