The role of visual spatial attention in audiovisual speech perception

Tobias Andersen, K. Tiippana, J. Laarni, I. Kojo, M. Sams

    Research output: Contribution to journalJournal articleResearchpeer-review

    720 Downloads (Pure)


    Auditory and visual information is integrated when perceiving speech, as evidenced by the McGurk effect in which viewing an incongruent talking face categorically alters auditory speech perception. Audiovisual integration in speech perception has long been considered automatic and pre-attentive but recent reports have challenged this view. Here we study the effect of visual spatial attention on the McGurk effect. By presenting a movie of two faces symmetrically displaced to each side of a central fixation point and dubbed with a single auditory speech track, we were able to discern the influences from each of the faces and from the voice on the auditory speech percept. We found that directing visual spatial attention towards a face increased the influence of that face on auditory perception. However, the influence of the voice on auditory perception did not change suggesting that audiovisual integration did not change. Visual spatial attention was also able to select between the faces when lip reading. This suggests that visual spatial attention acts at the level of visual speech perception prior to audiovisual integration and that the effect propagates through audiovisual integration to influence auditory perception.
    Original languageEnglish
    JournalSpeech Communication
    Issue number2
    Pages (from-to)184-193
    Publication statusPublished - 2009


    • Speech perception
    • McGurk effect
    • Multisensory
    • Attention


    Dive into the research topics of 'The role of visual spatial attention in audiovisual speech perception'. Together they form a unique fingerprint.

    Cite this