Efficient human activity recognition on edge devices using DeepConv LSTM architectures.
Journal:
Scientific reports
PMID:
40263516
Abstract
Driven by the rapid development of the Internet of Things (IoT), deploying deep learning models on resource-constrained hardware has become an increasingly critical challenge, which has propelled the emergence of TinyML as a viable solution. This study aims to deploy lightweight deep learning models for human activity recognition (HAR) using TinyML on edge devices. We designed and evaluated three models: a 2D Convolutional Neural Network (2D CNN), a 1D Convolutional Neural Network (1D CNN), and a DeepConv LSTM. Among these, the DeepConv LSTM outperformed existing lightweight models by effectively capturing both spatial and temporal features, achieving an accuracy of 98.24% and an F1 score of 98.23%. After performing full integer quantization on the best model, its size was reduced from 513.23 KB to 136.51 KB and was successfully deployed on the Arduino Nano 33 BLE Sense Rev2 using the Edge Impulse platform. The device's memory usage was 29.1 KB, flash usage was 189.6 KB, and the model's average inference time was 21 milliseconds, requiring approximately 0.01395 GOP, with a computational performance of around 0.664 GOPS. Even after quantization, the model maintained an accuracy of 97% and an F1 score of 97%, ensuring efficient utilization of computational resources. This deployment highlights the potential of TinyML in achieving low-latency and efficient HAR systems, making it suitable for real-time human activity recognition applications.