Radar Signal Processing and Its Impact on Deep Learning-Driven Human Activity Recognition.

Journal: Sensors (Basel, Switzerland)
PMID:

Abstract

Human activity recognition (HAR) using radar technology is becoming increasingly valuable for applications in areas such as smart security systems, healthcare monitoring, and interactive computing. This study investigates the integration of convolutional neural networks (CNNs) with conventional radar signal processing methods to improve the accuracy and efficiency of HAR. Three distinct, two-dimensional radar processing techniques, specifically range-fast Fourier transform (FFT)-based time-range maps, time-Doppler-based short-time Fourier transform (STFT) maps, and smoothed pseudo-Wigner-Ville distribution (SPWVD) maps, are evaluated in combination with four state-of-the-art CNN architectures: VGG-16, VGG-19, ResNet-50, and MobileNetV2. This study positions radar-generated maps as a form of visual data, bridging radar signal processing and image representation domains while ensuring privacy in sensitive applications. In total, twelve CNN and preprocessing configurations are analyzed, focusing on the trade-offs between preprocessing complexity and recognition accuracy, all of which are essential for real-time applications. Among these results, MobileNetV2, combined with STFT preprocessing, showed an ideal balance, achieving high computational efficiency and an accuracy rate of 96.30%, with a spectrogram generation time of 220 ms and an inference time of 2.57 ms per sample. The comprehensive evaluation underscores the importance of interpretable visual features for resource-constrained environments, expanding the applicability of radar-based HAR systems to domains such as augmented reality, autonomous systems, and edge computing.

Authors

  • Fahad Ayaz
    James Watt School of Engineering, University of Glasgow, Glasgow G12 8QQ, UK.
  • Basim Alhumaily
    James Watt School of Engineering, University of Glasgow, Glasgow G12 8QQ, UK.
  • Sajjad Hussain
    Faculty of Materials and Chemical Engineering, GIK Institute of Engineering Sciences and Technology, Topi, 23640, KPK, Pakistan; São Carlos Institute of Chemistry, University of São Paulo, Avenida Trabalhador São Carlense 400, 13566-590, São Carlos, SP, Brazil. Electronic address: sajjad.hussain@giki.edu.pk.
  • Muhammad Ali Imran
    James Watt School of EngineeringUniversity of Glasgow Glasgow G12 8QQ U.K.
  • Kamran Arshad
    College of Engineering and IT, Ajman University, Ajman 20550, United Arab Emirates.
  • Khaled Assaleh
    Department of Electrical and Computer Engineering, College of Engineering and Information Technology, Ajman University, Ajman, UAE.
  • Ahmed Zoha
    Department of Electrical and Electronic Engineering, University of Surrey, Surrey, United Kingdom.