Sliding-Window CNN + Channel-Time Attention Transformer Network Trained with Inertial Measurement Units and Surface Electromyography Data for the Prediction of Muscle Activation and Motion Dynamics Leveraging IMU-Only Wearables for Home-Based Shoulder Rehabilitation.

Journal: Sensors (Basel, Switzerland)
PMID:

Abstract

Inertial Measurement Units (IMUs) are widely utilized in shoulder rehabilitation due to their portability and cost-effectiveness, but their reliance on spatial motion data restricts their use in comprehensive musculoskeletal analyses. To overcome this limitation, we propose SWCTNet (Sliding Window CNN + Channel-Time Attention Transformer Network), an advanced neural network specifically tailored for multichannel temporal tasks. SWCTNet integrates IMU and surface electromyography (sEMG) data through sliding window convolution and channel-time attention mechanisms, enabling the efficient extraction of temporal features. This model enables the prediction of muscle activation patterns and kinematics using exclusively IMU data. The experimental results demonstrate that the SWCTNet model achieves recognition accuracies ranging from 87.93% to 91.03% on public temporal datasets and an impressive 98% on self-collected datasets. Additionally, SWCTNet exhibits remarkable precision and stability in generative tasks: the normalized DTW distance was 0.12 for the normal group and 0.25 for the patient group when using the self-collected dataset. This study positions SWCTNet as an advanced tool for extracting musculoskeletal features from IMU data, paving the way for innovative applications in real-time monitoring and personalized rehabilitation at home. This approach demonstrates significant potential for long-term musculoskeletal function monitoring in non-clinical or home settings, advancing the capabilities of IMU-based wearable devices.

Authors

  • Aoyang Bai
    College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China.
  • Hongyun Song
    2nd Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou 310009, China.
  • Yan Wu
    Beijing Hui-Long-Guan Hospital, Peking University, Beijing, 100096, China.
  • Shurong Dong
    College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China.
  • Gang Feng
    Environment and Plant Protection Institute, Chinese Academy of Tropical Agricultural Science, Haikou 571010, People's Republic of China; Key Laboratory of Monitoring and Control of Tropical Agricultural and Forest Invasive Alien Pests, Ministry of Agriculture, Haikou 571010, People's Republic of China. Electronic address: feng8513@sina.com.
  • Hao Jin
    School of Statistics and Management, Shanghai University of Finance and Economics, Shanghai 200433, China.