HARNet in deep learning approach-a systematic survey.

Journal: Scientific reports
Published Date:

Abstract

A comprehensive examination of human action recognition (HAR) methodologies situated at the convergence of deep learning and computer vision is the subject of this article. We examine the progression from handcrafted feature-based approaches to end-to-end learning, with a particular focus on the significance of large-scale datasets. By classifying research paradigms, such as temporal modelling and spatial features, our proposed taxonomy illuminates the merits and drawbacks of each. We specifically present HARNet, an architecture for Multi-Model Deep Learning that integrates recurrent and convolutional neural networks while utilizing attention mechanisms to improve accuracy and robustness. The VideoMAE v2 method ( https://github.com/OpenGVLab/VideoMAEv2 ) has been utilized as a case study to illustrate practical implementations and obstacles. For researchers and practitioners interested in gaining a comprehensive understanding of the most recent advancements in HAR as they relate to computer vision and deep learning, this survey is an invaluable resource.

Authors

  • Neelam Sanjeev Kumar
    Department of Computer Science and Engineering, SRM Institute of Science and Technology, Vadapalani, Chennai, Tamil Nadu, 600026, India.
  • G Deepika
    Department of Electronics and Communication Engineering, St. Peter's Engineering College, Dhulapally, Hyderabad, 500100, India.
  • V Goutham
    Department of Computer Science and Engineering, St Mary's Group of Institutions, Hyderabad, 500100, India.
  • B Buvaneswari
    Department of Information Technology, Panimalar Engineering College, Poonamallee, Chennai, Tamil Nadu, 600123, India.
  • R Vijaya Kumar Reddy
    Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh, 522502, India.
  • Sanjeevkumar Angadi
    Department of Computer Science and Engineering, Nutan College of Engineering and Research, Talegaon Dabhade, Pune, 410507, India.
  • C Dhanamjayulu
    School of Electrical Engineering, Vellore Institute of Technology, Vellore, India. dhanamjayulu.c@vit.ac.in.
  • Ravikumar Chinthaginjala
    School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.
  • Faruq Mohammad
    Department of Chemistry, College of Science, King Saud University, P.O. Box 2455, 11451, Riyadh, Kingdom of Saudi Arabia.
  • Baseem Khan
    Hawassa University, Hawassa, Ethiopia.