LIPPS – A Virtual Teacher for Speechreading Based on a Dialog-Controlled Talking-Head

Hermann Gebert, Hans-Heinrich Bothe

Research output: Contribution to journalConference articleResearchpeer-review

Abstract

People with decreasing hearing ability are more dependent on alternative personal communication channels. To read the visible articulator movements of the conversation partner is one possible solution for understanding verbal statements. After giving an introduction to the principals of speech, visual speech & speechreading, we demonstrate the conception and implementation of a language laboratory for speechreading that is meant as an effective audio-visual complement and extension of classroom teaching. Further we show results of evaluation experiments and explain the functionality and interaction of the modules, the interaction between student, teacher, and virtual teacher and the structure of the pedagogical approach to teach speechreading with the help of a virtual teacher.
Original languageEnglish
Book seriesLecture Notes in Computer Science
Volume6179
Pages (from-to)621-629
ISSN0302-9743
DOIs
Publication statusPublished - 2010
Event12th International Conference on Computers Helping People with Special Needs - Vienna, Austria
Duration: 14 Jul 201016 Jul 2010
Conference number: 12
http://www.icchp.org/node/293

Conference

Conference12th International Conference on Computers Helping People with Special Needs
Number12
CountryAustria
CityVienna
Period14/07/201016/07/2010
Internet address

Keywords

  • Lipreading
  • Language tutor
  • Hard-of-hearing
  • Training-aid
  • Speechreading
  • Audio-visual
  • Embodied conversational
  • Facial animation
  • Sudden deafness
  • Deaf

Fingerprint

Dive into the research topics of 'LIPPS – A Virtual Teacher for Speechreading Based on a Dialog-Controlled Talking-Head'. Together they form a unique fingerprint.

Cite this