Neural network-based ensemble approach for multi-view facial expression recognition.

Journal: PloS one
PMID:

Abstract

In this paper, we developed a pose-aware facial expression recognition technique. The proposed technique employed K nearest neighbor for pose detection and a neural network-based extended stacking ensemble model for pose-aware facial expression recognition. For pose-aware facial expression classification, we have extended the stacking ensemble technique from a two-level ensemble model to three-level ensemble model: base-level, meta-level and predictor. The base-level classifier is the binary neural network. The meta-level classifier is a pool of binary neural networks. The outputs of binary neural networks are combined using probability distribution to build the neural network ensemble. A pool of neural network ensembles is trained to learn the similarity between multi-pose facial expressions, where each neural network ensemble represents the presence or absence of a facial expression. The predictor is the Naive Bayes classifier, it takes the binary output of stacked neural network ensembles and classifies the unknown facial image as one of the facial expressions. The facial concentration region was detected using the Voila-Jones face detector. The Radboud faces database was used for stacked ensembles' training and testing purpose. The experimental results demonstrate that the proposed technique achieved 90% accuracy using Eigen features with 160 stacked neural network ensembles and Naive Bayes classifier. It demonstrates that the proposed techniques performed significantly as compare to state of the art pose-ware facial expression recognition techniques.

Authors

  • Muhammad Faheem Altaf
    Department of Computer Science, Superior University Lahore, Lahore, Pakistan.
  • Muhammad Waseem Iqbal
    Department of Software Engineering, Superior University, Lahore, Pakistan.
  • Ghulam Ali
    Department of Computer Science, University of Okara, Okara, Pakistan.
  • Khlood Shinan
    Department of Computers, College of Engineering and Computers in Al-Lith, Umm Al-Qura University, Makkah, Saudi Arabia.
  • Hanan E Alhazmi
    Computer Science Department, College of Computer and Information Systems, Umm Al-Qura University, Makkah, Saudi Arabia.
  • Fatmah Alanazi
    Computer Science Department, College of Computer and Information Sciences, Imam Muhammad Bin Saud University, Riyadh, Saudi Arabia.
  • M Usman Ashraf
    Department of Computer Science, GC Women University, Sialkot 51310, Pakistan.