[Development and evaluation of a deep learning algorithm for German word recognition from lip movements].

Journal: HNO
PMID:

Abstract

BACKGROUND: When reading lips, many people benefit from additional visual information from the lip movements of the speaker, which is, however, very error prone. Algorithms for lip reading with artificial intelligence based on artificial neural networks significantly improve word recognition but are not available for the German language.

Authors

  • Dinh Nam Pham
    Universitätsklinik und Poliklinik für Hals‑, Nasen‑, Ohrenheilkunde, Kopf- und Halschirurgie, Universitätsklinikum Halle (Saale), Martin-Luther-Universität Halle-Wittenberg, Ernst-Grube-Str. 40, 06120, Halle (Saale), Deutschland.
  • Torsten Rahne
    Universitätsklinik und Poliklinik für Hals‑, Nasen‑, Ohrenheilkunde, Kopf- und Halschirurgie, Universitätsklinikum Halle (Saale), Martin-Luther-Universität Halle-Wittenberg, Ernst-Grube-Str. 40, 06120, Halle (Saale), Deutschland. torsten.rahne@uk-halle.de.