Driver Fatigue Detection Based on Convolutional Neural Networks Using EM-CNN.

Journal: Computational intelligence and neuroscience
Published Date:

Abstract

With a focus on fatigue driving detection research, a fully automated driver fatigue status detection algorithm using driving images is proposed. In the proposed algorithm, the multitask cascaded convolutional network (MTCNN) architecture is employed in face detection and feature point location, and the region of interest (ROI) is extracted using feature points. A convolutional neural network, named EM-CNN, is proposed to detect the states of the eyes and mouth from the ROI images. The percentage of eyelid closure over the pupil over time (PERCLOS) and mouth opening degree (POM) are two parameters used for fatigue detection. Experimental results demonstrate that the proposed EM-CNN can efficiently detect driver fatigue status using driving images. The proposed algorithm EM-CNN outperforms other CNN-based methods, i.e., AlexNet, VGG-16, GoogLeNet, and ResNet50, showing accuracy and sensitivity rates of 93.623% and 93.643%, respectively.

Authors

  • Zuopeng Zhao
    School of Computer Science and Technology & Mine Digitization Engineering Research Center of Ministry of Education of the People's Republic of China, China University of Mining and Technology, Xuzhou 221116, China.
  • Nana Zhou
    School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China.
  • Lan Zhang
    Mental Health Center, West China Hospital, Sichuan University, Chengdu, China.
  • Hualin Yan
    School of Computer Science and Technology & Mine Digitization Engineering Research Center of the Ministry of Education of the People's Republic of China, China University of Mining and Technology, Xuzhou 221116, China.
  • Yi Xu
    School of Food and Biological Engineering, Jiangsu University, Zhenjiang 212013, PR China.
  • Zhongxin Zhang
    School of Computer Science and Technology & Mine Digitization Engineering Research Center of the Ministry of Education of the People's Republic of China, China University of Mining and Technology, Xuzhou 221116, China.