汉语母语者视听言语知觉发展趋势研究

doi:10.16187/j.cnki.issn1001-4918.2021.06.02

摘要/Abstract

摘要： 6~12岁儿童、13~18岁青少年和20~30岁成人被试各30名，运用McGurk效应研究范式对汉语母语者视听言语知觉的发展趋势进行探讨。所有被试需要接受纯听和视听两种条件下的测试，其任务是出声报告自己听到的刺激。结果发现：（1）三个年龄阶段汉语母语者被试在安静听力环境下的单音节加工中都受到了视觉线索的影响，表现出了McGurk效应；（2）三个年龄阶段汉语母语者被试McGurk效应的强度存在显著差异，其受视觉言语影响的程度表现出随年龄增长而增强的发展趋势；（3）13岁以后汉语被试在视听一致下对视觉线索的依赖没有显著增强，但是在视听冲突下视觉言语的影响仍然在逐渐增强。

关键词: 视听言语知觉, McGurk效应, 视觉言语

Abstract: Using the McGurk paradigm, the present study explored the developmental trends of audiovisual perception of Chinese children and adults, 30 children aged 6~12, 30 teenagers aged 13~18 and 30 adults aged 20~30 were requested to repeat the monosyllable presented in the audiovisual and audio-only modality. The results showed the speech perception were significantly affected by the visual cues for all subjects, and the magnitude of influence showed age difference. After the age of 13, the dependence on visual cues did not increase significantly under audiovisually congruent conditions, but the influence of visual speech is still gradually increasing under audiovisually incongruent conditions.

Key words: audiovisual speech perception, McGurk effect, visual speech

中图分类号:

B844

刘敏, 杜晓新, 刘巧云. 汉语母语者视听言语知觉发展趋势研究[J]. 心理发展与教育, 2021, 37(6): 768-773.

LIU Min, DU Xiaoxin, LIU Qiaoyun. The Development of Audiovisual Speech Perception in Native Chinese Speakers[J]. Psychological Development and Education, 2021, 37(6): 768-773.

参考文献

Barutchu, A., Danaher, J., Crewther, S. G., Innes-Brown, H., Shivdasani, M. N., & Paolini, A. G. (2010). Audiovisual integration in noise by children and adults. Journal of Experimental Child Psychology, 105(1-2), 38-50.
Green, K. P., Kuhl, P. K., & Meltzoff, A. N. (1988). Factors affecting the integration of auditory and visual information in speech:The effect of vowel environment. The Journal of the Acoustical Society of America, 84(S1), S155-S155.
Hirst, R. J., Stacey, J. E., Cragg, L., Stacey, P. C., & Allen, H. A. (2018). The threshold for the McGurk effect in audio-visual noise decreases with development.Scientific Reports, 8(1), 1-12.
Hockley, N. S., & Polka, L. (1994). A developmental study of audiovisual speech perception using the McGurk paradigm.The Journal of the Acoustical Society of America, 96(5), 3309-3318.
Hockley, W. E. (1994). Reflections of the mirror effect for item and associative recognition.Memory & Cognition, 22(6), 713-722.
Jiang, J., & Bernstein, L.E. (2011). Psychophysics of the McGurk and other audiovisual speech integration effects.Journal of Experimental Psychology:Human Perception and Performance, 37(4), 1193.
Kuhl, P., & Meltzoff, A. (1982). The bimodal perception of speech in infancy.Science, 218(4577), 1138-1141.
Lewkowicz, D. J., Minar, N. J., Tift, A. H., & Brandon, M. (2015). Perception of the multisensory coherence of fluent audiovisual speech in infancy:Its emergence and the role of experience. Journal of Experimental Child Psychology, 130, 147-162.
Magnotti, J. F., Mallick, D. B., Feng, G., Zhou, B., Zhou, W., & Beauchamp, M. S. (2016). Similar frequency of the McGurk effect in large samples of native mandarin Chinese and American English speakers.Experimental Brain Research, 233(9), 2581-2586.
Mallick, D. B. (2014). An investigation of audiovisual speech perception using the McGurk effect(Master's Thesis). Rice University. https://hdl.handle.net/1911/76346
Mallick, D. B., Magnotti, J. F., & Beauchamp, M. S. (2015). Variability and stability in the McGurk effect:Contributions of participants, stimuli, time, and response type.Psychonomic Bulletin & Review, 22(5), 1299-1307.
Massaro, D. W., Thompson, L. A., Barron, B., & Laren, E. (1986). Developmental changes in visual and auditory contributions to speech perception.Journal of Experimental Child Psychology, 41(1), 93-113.
Massaro, D. W., Cohen, M. M., Gesi, A., Heredia, R., & Tsuzaki, M. (1993). Bimodal speech perception:An examination across languages. Journal of Phonetics, 21(4), 445-478.
Mcgurk, H., & Macdonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746-748.
Narinesingh, C., Goltz, H. C., Raashid, R. A., & Wong, A. M. F. (2015). Developmental trajectory of mcgurk effect susceptibility in children and adults with amblyopia.Investigative Ophthalmology & Visual Science, 56(3), 2107-2113.
Ross, L. A., Del Bene, V. A., Molholm, S., Frey, H. P., & Foxe, J. J. (2015). Sex differences in multisensory speech processing in both typically developing children and those on the autism spectrum.Frontiers in Neuroscience, 9, 1-13.
Sekiyama, K., & Burnham, D. (2008). Impact of language on development of auditory-visual speech perception.Developmental Science, 11(2), 306-320.
Stropahl, M., Schellhardt, S., & Debener, S. (2017). McGurk stimuli for the investigation of multisensory integration in cochlear implant users:The Oldenburg Audio Visual Speech Stimuli (OLAVS). Psychonomic Bulletin & Review, 24(3), 863-872.
牟书.(2005).视听双通道言语整合机制的研究(博士学位论文).北京师范大学.
李燕芳.(2007).汉语母语者英语言语知觉的视听双通道特点研究(博士学位论文).北京师范大学.
黄昭鸣,朱群怡,卢红云.(2017).言语治疗学.上海:华东师范大学出版社.

多维度评价

Viewed

Full text

Abstract

Cited

Shared

Discussed

[1]	李燕芳, 董奇. 汉语母语儿童和成人视听双通道英语语音知觉的训练研究[J]. 心理发展与教育, 2009, 25(1): 72-78.
[2]	李燕芳, 梅磊磊, 董奇. 汉语母语者视听双通道言语知觉的特点及发展研究[J]. 心理发展与教育, 2008, 24(3): 43-47.