WAVE: Interactive Wave-based Sound Propagation for Virtual Environments
- 19 January 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 21 (4), 434-442
- https://doi.org/10.1109/tvcg.2015.2391858
Abstract
We present an interactive wave-based sound propagation system that generates accurate, realistic sound in virtual environments for dynamic (moving) sources and listeners. We propose a novel algorithm to accurately solve the wave equation for dynamic sources and listeners using a combination of precomputation techniques and GPU-based runtime evaluation. Our system can handle large environments typically used in VR applications, compute spatial sound corresponding to listener's motion (including head tracking) and handle both omnidirectional and directional sources, all at interactive rates. As compared to prior wave-based techniques applied to large scenes with moving sources, we observe significant improvement in runtime memory. The overall sound-propagation and rendering system has been integrated with the Half-Life 2 game engine, Oculus-Rift head-mounted display, and the Xbox game controller to enable users to experience high-quality acoustic effects (e.g., amplification, diffraction low-passing, high-order scattering) and spatial audio, based on their interactions in the VR application. We provide the results of preliminary user evaluations, conducted to study the impact of wave-based acoustic effects and spatial audio on users' navigation performance in virtual environments.Keywords
Funding Information
- Advanced Simulation and Training
- ARO Contracts (W911NF-12-1-0430, W911NF-13-C-0037, W911NF-14-1-0437)
- National Science Foundation (1320644, 1305286)
- Impulsonic Inc.
- Acoustect SDK
This publication has 30 references indexed in Scilit:
- Wave-based sound propagation in large open scenes using an equivalent source formulationACM Transactions on Graphics, 2013
- Interaural cross correlation in a sound field represented by spherical harmonicsThe Journal of the Acoustical Society of America, 2010
- Frequency Domain Acoustic Radiance Transfer for Real-Time AuralizationActa Acustica united with Acustica, 2009
- Effects of auditory information consistency and room acoustic cues on presence in virtual environmentsAcoustical Science and Technology, 2008
- Heritage and early history of the boundary element methodEngineering Analysis with Boundary Elements, 2005
- Psychological factors involved in auditory presence.Acoustical Science and Technology, 2003
- Presence Accompanying Induced Hearing Loss: Implications for Immersive Virtual EnvironmentsPRESENCE: Virtual and Augmented Reality, 2000
- An analytic secondary source model of edge diffraction impulse responsesThe Journal of the Acoustical Society of America, 1999
- The full-field equations for acoustic radiation and scatteringThe Journal of the Acoustical Society of America, 1999
- Navigation System for the Blind: Auditory Display Modes and GuidancePRESENCE: Virtual and Augmented Reality, 1998