The performance allowing users to switch between three different rotating camera positions, but the real trick was its binaural soundtrack: the perspective of what you heard would change depending on where you were looking. ChrisMilk has also ported this to Oculus Rift and the result has been described “stunning”.
According to Chris Milk, who also co-developed the “Hello Again“, with a finger clicker I could toggle between the three different camera positions, and was able to look around with a full 360-degree field of view at all times. When the orchestra’s strings were behind me, they sounded like they were behind me. When I looked over my shoulder to watch the vocalists, their voices swung around to match. Sound provides crucial information that helps us understand the world around us, but it’s easy to take for granted.Diving into “Sound and Vision” made it fundamentally clear how important audio is going to be to the success of VR experiences.
“What people will actually do with the headset remains the great unanswered question. The Sundance demos offer a hint of what’s next: each contained one or two of what could be considered minor innovations, but all of them together — compounded by the lessons learned from every other Oculus project — are slowly beginning to form the collective vocabulary of VR design. Whether it’s removing theater seats or creating 360-degree sonic soundscapes, those ideas and concepts are shaping an entirely new medium with unknowable potential — right here, right now.
- Oculus Rift at Sundance: game are just the beginning, Beck’s Sound and Vision takes you to a Virtual Concert by Bryan Bishop. 29 January 2014.
- Oculus Rift to Revolutionize Concerts and Movies by Allinson Blackburn. 3 Feb 2014.