视听跨通道言语知觉的McGurk效应:证据与模型

Translated title of the contribution: A Review of Audiovisual Speech Perception Based on McGurk Effect: Evidences and Models

Shanhu Hong, Biao Zeng

Research output: Contribution to journalArticlepeer-review

1321 Downloads (Pure)

Abstract

The McGurk effect is a widely used paradigm in the study of audiovisual speech perception, which sheds light on the role of visual information in speech perception and recognition. After reviewing research spanning over four decades, it has been observed that this effect is influenced by various factors, including the characteristics and quality of the auditory and visual signals, individual traits, attention, development, language, and culture. However, comparisons between studies have yielded inconsistent results regarding developmental and cross-language factors. Moreover, it has been suggested that the cognitive process underlying the McGurk effect occurs through different stages, and the brain regions involved may extend beyond the superior temporal and sub-frontal cortex. Additionally, the neural mechanisms of audiovisual integration may differ among various groups. Computational models also hold significant research value and should not be overlooked. Future studies can utilize these models in conjunction with neuroscience to explore special populations and investigate audiovisual suprasegmental speech stimuli. Further research is necessary to interpret the discrepancies among existing studies and provide a comprehensive understanding of the McGurk effect.
Translated title of the contributionA Review of Audiovisual Speech Perception Based on McGurk Effect: Evidences and Models
Original languageChinese (Simplified)
Pages (from-to)57-65
JournalJournal of Quanzhou Normal University
Volume41
Issue number6
Publication statusPublished - Dec 2023

Fingerprint

Dive into the research topics of 'A Review of Audiovisual Speech Perception Based on McGurk Effect: Evidences and Models'. Together they form a unique fingerprint.

Cite this