Biosignal Sensors and Deep Learning-Based Speech Recognition: A Review.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Voice is one of the essential mechanisms for communicating and expressing one's intentions as a human being. There are several causes of voice inability, including disease, accident, vocal abuse, medical surgery, ageing, and environmental pollution, and the risk of voice loss continues to increase. Novel approaches should have been developed for speech recognition and production because that would seriously undermine the quality of life and sometimes leads to isolation from society. In this review, we survey mouth interface technologies which are mouth-mounted devices for speech recognition, production, and volitional control, and the corresponding research to develop artificial mouth technologies based on various sensors, including electromyography (EMG), electroencephalography (EEG), electropalatography (EPG), electromagnetic articulography (EMA), permanent magnet articulography (PMA), gyros, images and 3-axial magnetic sensors, especially with deep learning techniques. We especially research various deep learning technologies related to voice recognition, including visual speech recognition, silent speech interface, and analyze its flow, and systematize them into a taxonomy. Finally, we discuss methods to solve the communication problems of people with disabilities in speaking and future research with respect to deep learning components.

Authors

  • Wookey Lee
    Department of Industrial Engineering, Inha University, Incheon, South Korea.
  • Jessica Jiwon Seong
    Department of Industrial Security Governance, Inha University, 100 Inharo, Incheon 22212, Korea.
  • Busra Ozlu
    Biomedical Science and Engineering & Department of Chemical Engineering, Inha University, 100 Inharo, Incheon 22212, Korea.
  • Bong Sup Shim
    Biomedical Science and Engineering & Department of Chemical Engineering, Inha University, 100 Inharo, Incheon 22212, Korea.
  • Azizbek Marakhimov
    Frontier College, Inha University, 100 Inharo, Incheon 22212, Korea.
  • Suan Lee
    School of Computer Science, Semyung University, Jecheon, Chungchungbuk-do, South Korea.