Improved facial emotion recognition model based on a novel deep convolutional structure.

Journal: Scientific reports
PMID:

Abstract

Facial Emotion Recognition (FER) is a very challenging task due to the varying nature of facial expressions, occlusions, illumination, pose variations, cultural and gender differences, and many other aspects that cause a drastic degradation in quality of facial images. In this paper, an anti-aliased deep convolution network (AA-DCN) model has been developed and proposed to explore how anti-aliasing can increase and improve recognition fidelity of facial emotions. The AA-DCN model detects eight distinct emotions from image data. Furthermore, their features have been extracted using the proposed model and numerous classical deep learning algorithms. The proposed AA-DCN model has been applied to three different datasets to evaluate its performance: The Cohn-Kanade Extending (CK+) database has been utilized, achieving an ultimate accuracy of 99.26% in (5 min, 25 s), the Japanese female facial expressions (JAFFE) obtained 98% accuracy in (8 min, 13 s), and on one of the most challenging FER datasets; the Real-world Affective Face (RAF) dataset; reached 82%, in low training time (12 min, 2s). The experimental results demonstrate that the anti-aliased DCN model is significantly increasing emotion recognition while improving the aliasing artifacts caused by the down-sampling layers.

Authors

  • Reham A Elsheikh
    Department of Electronics and Communications Engineering, Faculty of Engineering, Mansoura University, Mansoura, Egypt. reham178891@gmail.com.
  • M A Mohamed
    Department of Chemical Pathology, Medical Research Institute.
  • Ahmed Mohamed Abou-Taleb
    Department of Electronics and Communications Engineering, Faculty of Engineering, Mansoura University, Mansoura, Egypt.
  • Mohamed Maher Ata
    School of Computational Sciences and Artificial Intelligence (CSAI), Zewail City of Science and Technology, October Gardens, 6th of October City, 12578, Giza, Egypt. momaher@zewailcity.edu.eg.