Application for Recognizing Sign Language Gestures Based on an Artificial Neural Network.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

This paper presents the development and implementation of an application that recognizes American Sign Language signs with the use of deep learning algorithms based on convolutional neural network architectures. The project implementation includes the development of a training set, the preparation of a module that converts photos to a form readable by the artificial neural network, the selection of the appropriate neural network architecture and the development of the model. The neural network undergoes a learning process, and its results are verified accordingly. An internet application that allows recognition of sign language based on a sign from any photo taken by the user is implemented, and its results are analyzed. The network effectiveness ratio reaches 99% for the training set. Nevertheless, conclusions and recommendations are formulated to improve the operation of the application.

Authors

  • Kamil Kozyra
    Ailleron SA, Jana Pawła II 43b, 31-864 Krakow, Poland.
  • Karolina Trzyniec
    Department of Machinery Exploitation, Ergonomics and Production Processes, University of Agriculture in Krakow, Balicka 116B, 30-149 Krakow, Poland.
  • Ernest Popardowski
    Ailleron SA, Jana Pawła II 43b, 31-864 Krakow, Poland.
  • Maria Stachurska
    Institute of Safety and Quality Engineering, Faculty of Management Engineering, Poznań University of Technology, J. Rychlewskiego 2, 60-965 Poznan, Poland.