LIPPS – A Virtual Teacher for Speechreading Based on a Dialog-Controlled Talking-Head

Hermann Gebert, Hans-Heinrich Bothe

    Research output: Contribution to journalConference articleResearchpeer-review

    Abstract

    People with decreasing hearing ability are more dependent on alternative personal communication channels. To read the visible articulator movements of the conversation partner is one possible solution for understanding verbal statements. After giving an introduction to the principals of speech, visual speech & speechreading, we demonstrate the conception and implementation of a language laboratory for speechreading that is meant as an effective audio-visual complement and extension of classroom teaching. Further we show results of evaluation experiments and explain the functionality and interaction of the modules, the interaction between student, teacher, and virtual teacher and the structure of the pedagogical approach to teach speechreading with the help of a virtual teacher.
    Original languageEnglish
    Book seriesLecture Notes in Computer Science
    Volume6179
    Pages (from-to)621-629
    ISSN0302-9743
    DOIs
    Publication statusPublished - 2010
    Event12th International Conference on Computers Helping People with Special Needs - Vienna, Austria
    Duration: 14 Jul 201016 Jul 2010
    Conference number: 12
    http://www.icchp.org/node/293

    Conference

    Conference12th International Conference on Computers Helping People with Special Needs
    Number12
    Country/TerritoryAustria
    CityVienna
    Period14/07/201016/07/2010
    Internet address

    Keywords

    • Lipreading
    • Language tutor
    • Hard-of-hearing
    • Training-aid
    • Speechreading
    • Audio-visual
    • Embodied conversational
    • Facial animation
    • Sudden deafness
    • Deaf

    Fingerprint

    Dive into the research topics of 'LIPPS – A Virtual Teacher for Speechreading Based on a Dialog-Controlled Talking-Head'. Together they form a unique fingerprint.

    Cite this