Sound and Vision with VR Experience

The performance allowing users to switch between three different rotating camera positions, but the real trick was its binaural soundtrack: the perspective of what you heard would change depending on where you were looking.  ChrisMilk has also ported this to Oculus Rift and the result has been  described “stunning”.

According to Chris Milk, who also co-developed the “Hello Again“,  with a finger clicker I could toggle between the three different camera positions, and was able to look around with a full 360-degree field of view at all times. When the orchestra’s strings were behind me, they sounded like they were behind me. When I looked over my shoulder to watch the vocalists, their voices swung around to match. Sound provides crucial information that helps us understand the world around us, but it’s easy to take for granted.Diving into “Sound and Vision” made it fundamentally clear how important audio is going to be to the success of VR experiences.

“What people will actually do with the headset remains the great unanswered question. The Sundance demos offer a hint of what’s next: each contained one or two of what could be considered minor innovations, but all of them together — compounded by the lessons learned from every other Oculus project — are slowly beginning to form the collective vocabulary of VR design. Whether it’s removing theater seats or creating 360-degree sonic soundscapes, those ideas and concepts are shaping an entirely new medium with unknowable potential — right here, right now.



Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s