A Hybrid Model for Driver Emotion Detection Using Feature Fusion Approach.

Journal: International journal of environmental research and public health
Published Date:

Abstract

Machine and deep learning techniques are two branches of artificial intelligence that have proven very efficient in solving advanced human problems. The automotive industry is currently using this technology to support drivers with advanced driver assistance systems. These systems can assist various functions for proper driving and estimate drivers' capability of stable driving behavior and road safety. Many studies have proved that the driver's emotions are the significant factors that manage the driver's behavior, leading to severe vehicle collisions. Therefore, continuous monitoring of drivers' emotions can help predict their behavior to avoid accidents. A novel hybrid network architecture using a deep neural network and support vector machine has been developed to predict between six and seven driver's emotions in different poses, occlusions, and illumination conditions to achieve this goal. To determine the emotions, a fusion of Gabor and LBP features has been utilized to find the features and been classified using a support vector machine classifier combined with a convolutional neural network. Our proposed model achieved better performance accuracy of 84.41%, 95.05%, 98.57%, and 98.64% for FER 2013, CK+, KDEF, and KMU-FED datasets, respectively.

Authors

  • Suparshya Babu Sukhavasi
    Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA.
  • Susrutha Babu Sukhavasi
    Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA.
  • Khaled Elleithy
    Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA.
  • Ahmed El-Sayed
  • Abdelrahman Elleithy
    Department of Computer Science, William Paterson University, Wayne, NJ 07470, USA.