EI / SCOPUS / CSCD 收录

中文核心期刊

Volume 49 Issue 6
Nov.  2024
Turn off MathJax
Article Contents
Abstract
References
ZHU Liwei, YU Guangzheng, WANG Yewei, HE Pu. Effect of visual stimulus on auditory sound source localization in the median plane[J]. ACTA ACUSTICA, 2024, 49(6): 1197-1205. DOI: 10.12395/0371-0025.2023268
Citation: ZHU Liwei, YU Guangzheng, WANG Yewei, HE Pu. Effect of visual stimulus on auditory sound source localization in the median plane[J]. ACTA ACUSTICA, 2024, 49(6): 1197-1205. DOI: 10.12395/0371-0025.2023268
shu

Effect of visual stimulus on auditory sound source localization in the median plane

  • Acoustic Lab., School of Physics and Optoelectronics, South China University of Technology　Guangzhou　510641

More Information
  • PACS: 
    • 43.66  (Psychological acoustics)
    • 43.71  (Speech perception)
  • Received Date: November 21, 2023
  • Revised Date: February 23, 2024
  • Available Online: May 15, 2024
    Graphical Abstract
    • Abstract

  • A psychoacoustic experiment is conducted to address the effect of visual stimulus on auditory sound source localization in the median plane. The experimental results are analyzed based on perceptual fusion rate (the proportion of perceptual unification of visual and auditory stimuli) and cross-modal localization bias (the degree to which auditory sound source localization is affected by visual stimulus). The results indicate that altering the relative locations of visual and auditory stimuli leads to significant variation in perceptual fusion rate. The effect of perceptual fusion on auditory sound source localization is significant. In the fusion cases, sound source localization is distributed near visual stimulus. In the non-fusion cases, sound source localization is unaffected by visual stimulus and even away from it.

    • FullText(HTML)
    • References (31)
  • [1]
    Miller L M, D'esposito M. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J. Neurosci., 2005; 25(25): 5884−5893 DOI: 10.1523/JNEUROSCI.0896-05.2005
    [2]
    Stein B E, Stanford T R, Rowland B A. The neural basis of multisensory integration in the midbrain: its organization and maturation. Hear. Res., 2009; 258(1-2): 4−15 DOI: 10.1016/j.heares.2009.03.012
    [3]
    Howard R. Punch and Judy in 19th century America: A history and biographical dictionary. Jefferson, NC: McFarland, 2013
    [4]
    Satz A, Wood J. Articulate objects: Voice, sculpture and performance. Lausanne, Switzerland: Peter Lang, 2009
    [5]
    Chen Y C, Spence C. Assessing the role of the ‘unity assumption’ on multisensory integration: A review. Front. Psychol., 2017; 8: 445 DOI: 10.3389/fpsyg.2017.00445
    [6]
    刘强. 多感觉整合脑机制研究. 博士学位论文, 重庆: 西南大学, 2010
    [7]
    杨伟平, 李胜楠, 李子默, 等. 老年人视听觉整合的影响因素及其神经机制. 心理科学进展, 2020; 28(5): 790−799
    [8]
    Chen L, Vroomen J. Intersensory binding across space and time: A tutorial review. Atten. Percept. Psychophys., 2013; 75: 790−811 DOI: 10.3758/s13414-013-0475-4
    [9]
    Hairston W D, Wallace M T, Vaughan J W, et al. Visual localization ability influences cross-modal bias. J. Cogn. Neurosci., 2003; 15(1): 20−29 DOI: 10.1162/089892903321107792
    [10]
    Bertelson P, Radeau M. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys., 1981; 29(6): 578−584 DOI: 10.3758/BF03207374
    [11]
    André C R, Corteel É, Embrechts J J, et al. Subjective evaluation of the audiovisual spatial congruence in the case of stereoscopic-3D video and wave field synthesis. Int. J. Hum. Comput. Stud., 2014; 72(1): 23−32 DOI: 10.1016/j.ijhcs.2013.09.004
    [12]
    Hendrickx E, Paquier M, Koehl V, et al. Ventriloquism effect with sound stimuli varying in both azimuth and elevation. J. Acoust. Soc. Am., 2015; 138(6): 3686−3697 DOI: 10.1121/1.4937758
    [13]
    Wallace M T, Roberson G, Hairston W D, et al. Unifying multisensory signals across time and space. Exp. Brain Res., 2004; 158(2): 252−258 DOI: 10.1007/s00221-004-1899-9
    [14]
    Welch R B, Warren D H. Immediate perceptual response to intersensory discrepancy. Psychol. Bull., 1980; 88(3): 638−667 DOI: 10.1037/0033-2909.88.3.638
    [15]
    Charbonneau G, Véronneau M, Boudrias-Fournier C, et al. The ventriloquist in periphery: Impact of eccentricity-related reliability on audio-visual localization. J. Vis., 2013; 13(12): 20 DOI: 10.1167/13.12.20
    [16]
    Alais D, Burr D. The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol., 2004; 14(3): 257−262 DOI: 10.1016/j.cub.2004.01.029
    [17]
    Körding K P, Beierholm U, Ma W J, et al. Causal inference in multisensory perception. PLoS One, 2007; 2(9): e943 DOI: 10.1371/journal.pone.0000943
    [18]
    Sato Y, Toyoizumi T, Aihara K. Bayesian inference explains perception of unity and ventriloquism aftereffect: Identification of common sources of audiovisual stimuli. Neural Comput., 2007; 19(12): 3335−3355 DOI: 10.1162/neco.2007.19.12.3335
    [19]
    Thurlow W R, Jack C E. Certain determinants of the “ventriloquism effect”. Percept. Mot. Skills, 1973; 36(3S): 1171−1184 DOI: 10.2466/pms.1973.36.3c.1171
    [20]
    Makous J C, Middlebrooks J C. Two-dimensional sound localization by human listeners. J. Acoust. Soc. Am., 1990; 87(5): 2188−2200 DOI: 10.1121/1.399186
    [21]
    Carlile S, Leong P, Hyams S. The nature and distribution of errors in sound localization by human listeners. Hear. Res., 1997; 114(1-2): 179−196 DOI: 10.1016/S0378-5955(97)00161-5
    [22]
    Xie B. Head-related transfer function and virtual auditory display. 2nd edition. USA: J. Ross Publishing, 2013
    [23]
    Blauert J. Spatial hearing: The psychophysics of human sound localization. Revised edition. Cambridge, MA: MIT Press, 1997
    [24]
    姚鼎鼎, 汤婕, 王瑀楠, 等. 耳机重放中三维听觉显示定位精度及反应时间的影响因素分析. 声学学报, 2024; 49(6): 1152−1161 DOI: 10.12395/0371-0025.2023096
    [25]
    International Telecommunication Union. Methods for the subjective assessment of small impairments in audio systems: Recommendation ITU-R BS. 1116-3. Geneva, Switzerland: ITU, 2015
    [26]
    Slutsky D A, Recanzone G H. Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 2001; 12(1): 7−10 DOI: 10.1097/00001756-200101220-00009
    [27]
    Wozny D R, Shams L. Computational characterization of visually induced auditory spatial adaptation. Front. Integr. Neurosci., 2011; 5: 75 DOI: 10.3389/fnint.2011.00075
    [28]
    Marly A, Yazdjian A, Soto-Faraco S. The role of conflict processing in multisensory perception: Behavioural and electroencephalography evidence. Philos. Trans. R. Soc. Lond. B Biol. Sci., 2023; 378(1886): 20220346 DOI: 10.1098/rstb.2022.0346
    [29]
    Rohe T, Noppeney U. Sensory reliability shapes perceptual inference via two mechanisms. J. Vis., 2015; 15(5): 22 DOI: 10.1167/15.5.22
    [30]
    Jiang J, Xie B, Mai H, et al. The role of dynamic cue in auditory vertical localisation. Appl. Acoust., 2019; 146: 398−408 DOI: 10.1016/j.apacoust.2018.12.002
    [31]
    Wenzel E M, Arruda M, Kistler D J, et al. Localization using nonindividualized head-related transfer functions. J. Acoust. Soc. Am., 1993; 94(1): 111−123 DOI: 10.1121/1.407089
    • Related Articles

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (133) PDF downloads (32) Cited by()
    Related

    Official Website

    WeChat

    Email Alert RSS

    Supported by: Beijing Renhe Information Technology Co., Ltd.  Baidu Analytics

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return