Sound source localization with varying amount of visual information in virtual reality.
Journal
PloS one
ISSN: 1932-6203
Titre abrégé: PLoS One
Pays: United States
ID NLM: 101285081
Informations de publication
Date de publication:
2019
2019
Historique:
received:
26
11
2018
accepted:
17
03
2019
entrez:
30
3
2019
pubmed:
30
3
2019
medline:
18
12
2019
Statut:
epublish
Résumé
To achieve accurate spatial auditory perception, subjects typically require personal head-related transfer functions (HRTFs) and the freedom for head movements. Loudspeaker-based virtual sound environments allow for realism without individualized measurements. To study audio-visual perception in realistic environments, the combination of spatially tracked head mounted displays (HMDs), also known as virtual reality glasses, and virtual sound environments may be valuable. However, HMDs were recently shown to affect the subjects' HRTFs and thus might influence sound localization performance. Furthermore, due to limitations of the reproduction of visual information on the HMD, audio-visual perception might be influenced. Here, a sound localization experiment was conducted both with and without an HMD and with a varying amount of visual information provided to the subjects. Furthermore, interaural time and level difference errors (ITDs and ILDs) as well as spectral perturbations induced by the HMD were analyzed and compared to the perceptual localization data. The results showed a reduction of the localization accuracy when the subjects were wearing an HMD and when they were blindfolded. The HMD-induced error in azimuth localization was found to be larger in the left than in the right hemisphere. When visual information of the limited set of source locations was provided, the localization error induced by the HMD was found to be negligible. Presenting visual information of hand-location and room dimensions showed better sound localization performance compared to the condition with no visual information. The addition of possible source locations further improved the localization accuracy. Also adding pointing feedback in form of a virtual laser pointer improved the accuracy of elevation perception but not of azimuth perception.
Identifiants
pubmed: 30925174
doi: 10.1371/journal.pone.0214603
pii: PONE-D-18-33857
pmc: PMC6440636
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e0214603Déclaration de conflit d'intérêts
The authors have declared that no competing interests exist.
Références
J Acoust Soc Am. 1975 Jan;57(1):181-7
pubmed: 1110279
Games Health J. 2018 Jun;7(3):151-156
pubmed: 29293369
Percept Psychophys. 1980 Dec;28(6):589-96
pubmed: 7208275
Curr Biol. 2014 Mar 31;24(7):748-52
pubmed: 24631242
J Acoust Soc Am. 1984 Apr;75(4):1195-200
pubmed: 6725769
J Acoust Soc Am. 1974 Dec;56(6):1829-34
pubmed: 4443482
Atten Percept Psychophys. 2010 Feb;72(2):454-69
pubmed: 20139459
Nat Neurosci. 1998 Sep;1(5):417-21
pubmed: 10196533
Hear Res. 1990 Aug 1;47(1-2):103-38
pubmed: 2228789
J Acoust Soc Am. 1977 Mar;61(3):829-34
pubmed: 853155
Perception. 1984;13(5):581-600
pubmed: 6535983
Hear Res. 2009 Dec;258(1-2):89-99
pubmed: 19393306
PLoS One. 2017 Mar 23;12(3):e0174185
pubmed: 28333967
Iperception. 2017 May 18;8(3):2041669517708205
pubmed: 28567271
J Acoust Soc Am. 1998 Jun;103(6):3656-66
pubmed: 9637047
Sci Rep. 2018 Nov 6;8(1):16399
pubmed: 30401920
Hear Res. 2013 Dec;306:76-92
pubmed: 24076423
J Acoust Soc Am. 1990 May;87(5):2188-200
pubmed: 2348023
J Neurophysiol. 2011 May;105(5):2471-86
pubmed: 21368004
Hear Res. 1997 Dec;114(1-2):179-96
pubmed: 9447931
J Acoust Soc Am. 2014 Aug;136(2):791-802
pubmed: 25096113
J Acoust Soc Am. 1997 Oct;102(4):2325-32
pubmed: 9348691
Front Psychol. 2013 Dec 12;4:932
pubmed: 24376430
Exp Brain Res. 1999 Mar;125(1):43-9
pubmed: 10100975
J Acoust Soc Am. 1998 Jun;103(6):3667-76
pubmed: 9637048
J Acoust Soc Am. 1999 Sep;106(3 Pt 1):1493-510
pubmed: 10489706