Criminal emotion detection framework using convolutional neural network for public safety.

Journal: Scientific reports
PMID:

Abstract

In the era of rapid societal modernization, the issue of crime stands as an intrinsic facet, demanding our attention and consideration. As our communities evolve and adopt technological advancements, the dynamic landscape of criminal activities becomes an essential aspect that requires careful examination and proactive approaches for public safety application. In this paper, we proposed a collaborative approach to detect crime patterns and criminal emotions with the aim of enhancing judiciary decision-making. For the same, we utilized two standard datasets - a crime dataset comprised of different features of crime. Further, the emotion dataset has 135 classes of emotion that help the AI model to efficiently find criminal emotions. We adopted a convolutional neural network (CNN) to get first trained on crime datasets to bifurcate crime and non-crime images. Once the crime is detected, criminal faces are extracted using the region of interest and stored in a directory. Different CNN architectures, such as LeNet-5, VGGNet, RestNet-50, and basic CNN, are used to detect different emotions of the face. The trained CNN models are used to detect criminal emotion and enhance judiciary decision-making. The proposed framework is evaluated with different evaluation metrics, such as training accuracy, loss, optimizer performance, precision-recall curve, model complexity, training time, and inference time. In crime detection, the CNN model achieves a remarkable accuracy of 92.45% and in criminal emotion detection, LeNet-5 outperforms other CNN architectures by offering an accuracy of 98.6%.

Authors

  • Jay Raval
    Department of Computer Science and Engineering, Institute of Technology, Nirma University, Ahmedabad, Gujarat, 382481, India.
  • Nilesh Kumar Jadav
    Department of Computer Engineering - AI, ML, & DS, Marwadi University, Rajkot, 360003, India. nilesh.jadav@marwadieducation.edu.in.
  • Sudeep Tanwar
    Department of Computer Science and Engineering, Institute of Technology, Nirma University, Ahmedabad, Gujarat, 382481, India. sudeep.tanwar@nirmauni.ac.in.
  • Giovanni Pau
    Faculty of Engineering and Architecture, Kore University of Enna, 94100, Enna, Italy.
  • Fayez Alqahtani
    Software Engineering Department, College of Computer and Information Sciences, King Saud University, Riyadh, 12372, Saudi Arabia.
  • Amr Tolba
    Computer Science Department, Community College, King Saud University, Riyadh, 11437, Saudi Arabia.