Multifunctional Human-Computer Interaction System Based on Deep Learning-Assisted Strain Sensing Array.

Journal: ACS applied materials & interfaces
PMID:

Abstract

Continuous and reliable monitoring of gait is crucial for health monitoring, such as postoperative recovery of bone joint surgery and early diagnosis of disease. However, existing gait analysis systems often suffer from large volumes and the requirement of special space for setting motion capture systems, limiting their application in daily life. Here, we develop an intelligent gait monitoring and analysis prediction system based on flexible piezoelectric sensors and deep learning neural networks with high sensitivity (241.29 mV/N), quick response (66 ms loading, 87 ms recovery), and excellent stability ( = 0.9946). The theoretical simulations and experiments confirm that the sensor provides exceptional signal feedback, which can easily acquire accurate gait data when fitted to shoe soles. By integrating high-quality gait data with a custom-built deep learning model, the system can detect and infer human motion states in real time (the recognition accuracy reaches 94.7%). To further validate the sensor's application in real life, we constructed a flexible wearable recognition system with human-computer interaction interface and a simple operation process for long-term and continuous tracking of athletes' gait, potentially aiding personalized health management, early detection of disease, and remote medical care.

Authors

  • Hao Gu
    Department of Ophthalmology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China.
  • Ke Jiang
    Paul C. Lauterbur Research Centre for Biomedical Imaging, Shenzhen Key Laboratory for MRI, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
  • Fei Yu
    Department of Nutrition and food hygiene, College of Public Health of Zhengzhou University, Zhengzhou, China, 450001. Electronic address: 53615631@qq.com.
  • Liying Wang
    Laboratory of Nutrition and Functional Food, Jilin University, Changchun 130062, People's Republic of China.
  • Xijia Yang
    Key Laboratory of Advanced Structural Materials, Ministry of Education & Advanced Institute of Materials Science, Changchun University of Technology, Changchun 130012, China.
  • Xuesong Li
    Department of Chemistry, University of Wyoming, Laramie, WY, United States.
  • Yi Jiang
    Institute of Genomic Medicine, Wenzhou Medical University, Wenzhou 325035, China.
  • Wei Lu
    Department of Pharmacy, Taihe Hospital, Hubei University of Medicine, Shiyan, China.
  • Xiaojuan Sun
    Department of Oncology, The Affiliated Hospital of Qingdao University, Qingdao, China.