Facial expression recognition using lightweight deep learning modeling.

Journal: Mathematical biosciences and engineering : MBE
Published Date:

Abstract

Facial expression is a type of communication and is useful in many areas of computer vision, including intelligent visual surveillance, human-robot interaction and human behavior analysis. A deep learning approach is presented to classify happy, sad, angry, fearful, contemptuous, surprised and disgusted expressions. Accurate detection and classification of human facial expression is a critical task in image processing due to the inconsistencies amid the complexity, including change in illumination, occlusion, noise and the over-fitting problem. A stacked sparse auto-encoder for facial expression recognition (SSAE-FER) is used for unsupervised pre-training and supervised fine-tuning. SSAE-FER automatically extracts features from input images, and the softmax classifier is used to classify the expressions. Our method achieved an accuracy of 92.50% on the JAFFE dataset and 99.30% on the CK+ dataset. SSAE-FER performs well compared to the other comparative methods in the same domain.

Authors

  • Mubashir Ahmad
    Department of Computer Science and IT, The University of Lahore, Sargodha Campus, Sargodha 40100, Pakistan.
  • Saira Sanawar
    Department of Computer Science, the University of Lahore, Sargodha Campus 40100, Pakistan.
  • Omar Alfandi
    College of Technological Innovation at Zayed University in Abu Dhabi, UAE.
  • Syed Furqan Qadri
    College of Computer Science and Software Engineering, Computer Vision Institute, Shenzhen University, Shenzhen 518060, Guangdong, China.
  • Iftikhar Ahmed Saeed
    Department of Computer Science and IT, The University of Lahore, Sargodha Campus, Sargodha 40100, Pakistan.
  • Salabat Khan
    College of Computer Science and Software Engineering, Computer Vision Institute, Shenzhen University, Shenzhen, Guangdong Province 518060, China.
  • Bashir Hayat
    Department of Computer Science, Institute of Management Sciences, Peshawar, Pakistan.
  • Arshad Ahmad
    Department of IT & CS, Pak-Austria Fachhochschule: Institute of Applied Sciences and Technology (PAF-IAST), Haripur 22620, Pakistan.