Back To Schedule
Wednesday, October 27 • 11:00am - 12:00pm
Spatial Audio Rendering for Interoperable XR Applications in the Audio Metaverse

Log in to save this to your schedule, view media, leave feedback and see who's attending!

Interactive audio spatialization technology previously developed for video game authoring and rendering has evolved into an essential component of platforms enabling shared immersive virtual experiences for future co-presence, remote collaboration and entertainment applications. New wearable virtual and augmented reality displays employ real-time binaural audio computing engines rendering multiple digital objects and supporting the free navigation of networked participants or their avatars through a juxtaposition of environments, real and virtual, often referred to as the Metaverse. These applications require a parametric audio scene programming interface to facilitate the creation and deployment of shared, dynamic and realistic virtual 3D worlds on mobile computing platforms and remote servers.

This tutorial surveys practical approaches for designing and programming 6-degree-of-freedom interactive audio engines to deliver the perceptually relevant binaural cues necessary for audio/visual and virtual/real congruence in Metaverse experiences. It addresses the effects of room reverberation, acoustic reflectors, and obstacles in both the virtual and real environments, and discusses how such effects may be driven by combinations of pre-computed and real-time acoustic propagation solvers. We envision an open scene description model distilled to facilitate the development of interoperable applications distributed across multiple platforms, where each audio object represents, to the user, a natural sound source having controllable distance, size, orientation, and acoustic radiation properties.

This presentation is an extended version of our recent i3DA conference presentation, aiming to promote industry collaboration towards a standardized representation of audio and acoustic environments in the XR Metaverse. (Paper: ieeexplore.ieee.org/document/9610971 or arxiv.org/pdf/2109.12471.pdf.) (Slides: tinyurl.com/y6nr5o8t.)

avatar for Jean-Marc Jot

Jean-Marc Jot

VP Research, Jean-Marc Jot
avatar for Rémi Audfray

Rémi Audfray

Owner, Remi Audfray Engineering

Wednesday October 27, 2021 11:00am - 12:00pm EDT
Stream A