Psychological Development and Education ›› 2021, Vol. 37 ›› Issue (6): 768-773.doi: 10.16187/j.cnki.issn1001-4918.2021.06.02

Previous Articles     Next Articles

The Development of Audiovisual Speech Perception in Native Chinese Speakers

LIU Min, DU Xiaoxin, LIU Qiaoyun   

  1. Department of Rehabilitation Science, East China Normal University, Shanghai 200062
  • Published:2021-11-16

RichHTML

PDF (PC)

Abstract: Using the McGurk paradigm, the present study explored the developmental trends of audiovisual perception of Chinese children and adults, 30 children aged 6~12, 30 teenagers aged 13~18 and 30 adults aged 20~30 were requested to repeat the monosyllable presented in the audiovisual and audio-only modality. The results showed the speech perception were significantly affected by the visual cues for all subjects, and the magnitude of influence showed age difference. After the age of 13, the dependence on visual cues did not increase significantly under audiovisually congruent conditions, but the influence of visual speech is still gradually increasing under audiovisually incongruent conditions.

Key words: audiovisual speech perception, McGurk effect, visual speech

CLC Number: 

  • B844
Barutchu, A., Danaher, J., Crewther, S. G., Innes-Brown, H., Shivdasani, M. N., & Paolini, A. G. (2010). Audiovisual integration in noise by children and adults. Journal of Experimental Child Psychology, 105(1-2), 38-50.
Green, K. P., Kuhl, P. K., & Meltzoff, A. N. (1988). Factors affecting the integration of auditory and visual information in speech:The effect of vowel environment. The Journal of the Acoustical Society of America, 84(S1), S155-S155.
Hirst, R. J., Stacey, J. E., Cragg, L., Stacey, P. C., & Allen, H. A. (2018). The threshold for the McGurk effect in audio-visual noise decreases with development.Scientific Reports, 8(1), 1-12.
Hockley, N. S., & Polka, L. (1994). A developmental study of audiovisual speech perception using the McGurk paradigm.The Journal of the Acoustical Society of America, 96(5), 3309-3318.
Hockley, W. E. (1994). Reflections of the mirror effect for item and associative recognition.Memory & Cognition, 22(6), 713-722.
Jiang, J., & Bernstein, L.E. (2011). Psychophysics of the McGurk and other audiovisual speech integration effects.Journal of Experimental Psychology:Human Perception and Performance, 37(4), 1193.
Kuhl, P., & Meltzoff, A. (1982). The bimodal perception of speech in infancy.Science, 218(4577), 1138-1141.
Lewkowicz, D. J., Minar, N. J., Tift, A. H., & Brandon, M. (2015). Perception of the multisensory coherence of fluent audiovisual speech in infancy:Its emergence and the role of experience. Journal of Experimental Child Psychology, 130, 147-162.
Magnotti, J. F., Mallick, D. B., Feng, G., Zhou, B., Zhou, W., & Beauchamp, M. S. (2016). Similar frequency of the McGurk effect in large samples of native mandarin Chinese and American English speakers.Experimental Brain Research, 233(9), 2581-2586.
Mallick, D. B. (2014). An investigation of audiovisual speech perception using the McGurk effect(Master's Thesis). Rice University. https://hdl.handle.net/1911/76346
Mallick, D. B., Magnotti, J. F., & Beauchamp, M. S. (2015). Variability and stability in the McGurk effect:Contributions of participants, stimuli, time, and response type.Psychonomic Bulletin & Review, 22(5), 1299-1307.
Massaro, D. W., Thompson, L. A., Barron, B., & Laren, E. (1986). Developmental changes in visual and auditory contributions to speech perception.Journal of Experimental Child Psychology, 41(1), 93-113.
Massaro, D. W., Cohen, M. M., Gesi, A., Heredia, R., & Tsuzaki, M. (1993). Bimodal speech perception:An examination across languages. Journal of Phonetics, 21(4), 445-478.
Mcgurk, H., & Macdonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746-748.
Narinesingh, C., Goltz, H. C., Raashid, R. A., & Wong, A. M. F. (2015). Developmental trajectory of mcgurk effect susceptibility in children and adults with amblyopia.Investigative Ophthalmology & Visual Science, 56(3), 2107-2113.
Ross, L. A., Del Bene, V. A., Molholm, S., Frey, H. P., & Foxe, J. J. (2015). Sex differences in multisensory speech processing in both typically developing children and those on the autism spectrum.Frontiers in Neuroscience, 9, 1-13.
Sekiyama, K., & Burnham, D. (2008). Impact of language on development of auditory-visual speech perception.Developmental Science, 11(2), 306-320.
Stropahl, M., Schellhardt, S., & Debener, S. (2017). McGurk stimuli for the investigation of multisensory integration in cochlear implant users:The Oldenburg Audio Visual Speech Stimuli (OLAVS). Psychonomic Bulletin & Review, 24(3), 863-872.
牟书.(2005).视听双通道言语整合机制的研究(博士学位论文).北京师范大学.
李燕芳.(2007).汉语母语者英语言语知觉的视听双通道特点研究(博士学位论文).北京师范大学.
黄昭鸣,朱群怡,卢红云.(2017).言语治疗学.上海:华东师范大学出版社.
[1] LI Yan-fang, DONG Qi. The Training Study of Chinese Children and Adults’ Audiovisual English Phonetic Perception [J]. Psychological Development and Education, 2009, 25(1): 72-78.
[2] LI Yan-fang, MEI Lei-lei, DONG Qi. The Characteristics and Development of Audiovisual Speech Perception in Native Chinese Speakers [J]. Psychological Development and Education, 2008, 24(3): 43-47.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of Psychological Development and Education
Supported by Beijing Magtech Co.Ltd