Ηand dexterities assessment in stroke patients based on augmented reality and machine learning through a box and block test.

Journal: Scientific reports
Published Date: May 8, 2024

Abstract

A popular and widely suggested measure for assessing unilateral hand motor skills in stroke patients is the box and block test (BBT). Our study aimed to create an augmented reality enhanced version of the BBT (AR-BBT) and evaluate its correlation to the original BBT for stroke patients. Following G-power analysis, clinical examination, and inclusion-exclusion criteria, 31 stroke patients were included in this study. AR-BBT was developed using the Open Source Computer Vision Library (OpenCV). The MediaPipe's hand tracking library uses a palm and a hand landmark machine learning model to detect and track hands. A computer and a depth camera were employed in the clinical evaluation of AR-BBT following the principles of traditional BBT. A strong correlation was achieved between the number of blocks moved in the BBT and the AR-BBT on the hemiplegic side (Pearson correlation = 0.918) and a positive statistically significant correlation (p = 0.000008). The conventional BBT is currently the preferred assessment method. However, our approach offers an advantage, as it suggests that an AR-BBT solution could remotely monitor the assessment of a home-based rehabilitation program and provide additional hand kinematic information for hand dexterities in AR environment conditions. Furthermore, it employs minimal hardware equipment.

Authors

  • Georgios Papagiannis
    Biomechanics Laboratory, Physiotherapy Department, University of the Peloponnese, 23100, Sparta, Greece. grpapagiannis@yahoo.gr.
  • Αthanasios Triantafyllou
    Biomechanics Laboratory, Physiotherapy Department, University of the Peloponnese, 23100, Sparta, Greece.
  • Konstantina G Yiannopoulou
    Physioloft, Physiotherapy Center, 14562, Kifisia, Greece.
  • George Georgoudis
    Department of Physiotherapy, University of West Attica, 12243, Athens, Greece.
  • Maria Kyriakidou
    Biomechanics Laboratory, Physiotherapy Department, University of the Peloponnese, 23100, Sparta, Greece.
  • Panagiotis Gkrilias
    Biomechanics Laboratory, Physiotherapy Department, University of the Peloponnese, 23100, Sparta, Greece.
  • Apostolos Z Skouras
    Sports Excellence, 1St Department of Orthopaedic Surgery, National and Kapodistrian University of Athens, 12462, Athens, Greece.
  • Xhoi Bega
    Physioloft, Physiotherapy Center, 14562, Kifisia, Greece.
  • Dimitrios Stasinopoulos
    Department of Physiotherapy, University of West Attica, 12243, Athens, Greece.
  • George Matsopoulos
    Biomedical Engineering Laboratory, National Technical University of Athens, 9, Herοon Polytechniou Str., Zografou, 15773, Athens, Greece.
  • Pantelis Syringas
    Biomedical Engineering Laboratory, National Technical University of Athens, 9, Herοon Polytechniou Str., Zografou, 15773, Athens, Greece.
  • Nikolaos Tselikas
    CNA Lab, Department of Informatics, Telecommunications University of Peloponnese, 22100, Tripoli, Greece.
  • Orestis Zestas
    CNA Lab, Department of Informatics, Telecommunications University of Peloponnese, 22100, Tripoli, Greece.
  • Vassiliki Potsika
    Unit of Medical Technology and Intelligent Information Systems, University of Ioannina, 45110, Ioannina, Greece.
  • Athanasios Pardalis
    Unit of Medical Technology and Intelligent Information Systems, University of Ioannina, 45110, Ioannina, Greece.
  • Christoforos Papaioannou
    Unit of Medical Technology and Intelligent Information Systems, University of Ioannina, 45110, Ioannina, Greece.
  • Vasilios Protopappas
    Ostacon Ltd, 167 77, Elliniko, Greece.
  • Nikolas Malizos
    Ostacon Ltd, 167 77, Elliniko, Greece.
  • Nikolaos Tachos
    FORTH-ICS, N Plastira 100, Heraklion, Crete, Greece.
  • Dimitrios I Fotiadis
    Biomedical Research Institute, Foundation for Research and Technology Hellas, Greece; Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, Greece.

Keywords

External Resources

Popular Topics
Recent Journals