Visual timing information in audiovisual speech perception: evidence from lexical tone contour

Hui Xie, Biao Zeng, Rui Wang

Research output: Contribution to conferencePaperpeer-review

13 Downloads (Pure)

Abstract

The present study investigated whether duration of lip movement could improve intelligibility of lexical pitch contours under noisy condition. Eighteen Chinese speakers were asked to identify a Mandarin lexical tone in one pair of tones under auditory only (AO) and audiovisual (AV) condition. Two types of tone pairs were used in the study: maximum contrastive pair (falling vs. dipping tones, the durational difference of lip movement was 100ms) and minimum contrastive pair (rising vs. falling tones, the difference was 33ms). The results showed that duration of lip movement enhanced discrimination in the maximum pair whereas the similar lengths of rising and dipping tones attenuated such visual benefit. The finding suggested that visual timing information could be a specific cue for audiovisual lexical tone perception.
Original languageEnglish
Publication statusPublished - 2 Sep 2018
EventINTERSPEECH 2018 - International Convention Centre, Hyderabad, India
Duration: 2 Sep 20186 Sep 2018

Conference

ConferenceINTERSPEECH 2018
Country/TerritoryIndia
CityHyderabad
Period2/09/186/09/18

Keywords

  • audiovisual speech
  • lexical tone
  • Chinese
  • visual timing

Fingerprint

Dive into the research topics of 'Visual timing information in audiovisual speech perception: evidence from lexical tone contour'. Together they form a unique fingerprint.

Cite this