A fundamental principle of virtual reality is the crafting of illusion which immerses and guides users. In contrast to the ample work on visual illusions and VR, auditory illusions remain relatively understudied. We are particularly interested in how VR can leverage auditory stimuli to manipulate user movement and perception of movement. Here we conduct trials to study how the sounds of footsteps can be manipulated to give the impression of upwards or downwards incline during walking, and how this compares to visual stimuli. We do so by crafting Shepard tone imbued footstep sounds which exploit the cross-modal correspondence between auditory pitch and elevation. We found that while our chosen visual stimuli were considerably more powerful, our footstep sounds still shifted the perception of movement direction, including when they contradicted the direction of visual stimuli. This study opens new research possibilities on how other auditory illusions can influence movement. The Shepard footsteps themselves have direct application in environments where the user must explore the vertical dimension of a 3D space.
Building similarity graph...
Analyzing shared references across papers
Loading...
B. Kieran McAuliffe
Eike Langbehn
IEEE Transactions on Visualization and Computer Graphics
HAW Hamburg
Building similarity graph...
Analyzing shared references across papers
Loading...
McAuliffe et al. (Thu,) studied this question.
www.synapsesocial.com/papers/69d893896c1944d70ce048f9 — DOI: https://doi.org/10.1109/tvcg.2026.3680676
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: