Primacy of Mouth over Eyes: Eye Movement Evidence from Audiovisual Mandarin Lexical Tones and Vowels

Biao Zeng, Rui Wang, Guoxing Yu, Christian Dobel

Allbwn ymchwil: Cyfraniad at gynhadleddPapuradolygiad gan gymheiriaid

76 Wedi eu Llwytho i Lawr (Pure)

Crynodeb

This study investigated Chinese speakers’ eye movements when they were asked to identify audiovisual Mandarin lexical tones and vowels. In the lexical tone identification task, Chinese speakers were presented with an audiovisual clip of Mandarin monosyllables (/ă/, /à/, /ĭ/, /ì/) and asked to identify whether the syllables were presented in a dipping (/ă/, / ĭ/) or falling tone (/à/, /ì/). In the vowel identification task, they were asked to identify whether the vowels were /a/ or /i/ regardless of lexical tone. These audiovisual syllables were presented in clear, noisy, and silent conditions. An eye-tracker recorded the participants’ eye movements.
Results showed participants gazed more at the mouth than the eyes in both lexical tones and vowels. Additionally, when acoustic conditions degraded from clear to noisy and eventually silent, Chinese speakers increased their gaze towards the mouth rather than the eyes. These findings suggest the mouth to be the primary area that is utilised during audiovisual speech perception. The similar patterns of eye movements between vowels and lexical tones indicate that the mouth acts as a perceptual cue that provides articulatory information.
Iaith wreiddiolSaesneg
StatwsCyhoeddwyd - 2021
DigwyddiadInterSpeech 2021 - Brno University of Technology, Brno, Y Weriniaeth Tsiec
Hyd: 30 Aug 20213 Sep 2021
https://www.interspeech2021.org/

Cynhadledd

CynhadleddInterSpeech 2021
Gwlad/TiriogaethY Weriniaeth Tsiec
DinasBrno
Cyfnod30/08/213/09/21
Cyfeiriad rhyngrwyd

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'Primacy of Mouth over Eyes: Eye Movement Evidence from Audiovisual Mandarin Lexical Tones and Vowels'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn