Title: Facial expression recognition of multiple stylised characters using deep convolutional neural network

Authors: Yogesh Kumar; Shashi Kant Verma; Sandeep Sharma

Addresses: Department of Computer Science and Engineering, Uttrakhand Technical University, Dehradun, Uttrakhand, India ' Department of Computer Science and Engineering, Govind Ballabh Pant Institute of Engineering and Technology, Pauri Garhwal, Uttarakhand, India ' Department of Electronics and Communication Engineering, DIT University, Dehradun, Uttarakhand, India

Abstract: Human faces manifest the treasury of their abilities including emotions, character, state of mind and many more. Apart from the things that are spoken, human faces conveys plenty of information in the form of facial expressions. Recognition of facial expressions has become significant in the discipline of human-computer interaction to attain the emotional state of human beings. This paper proposes a facial expression identification method (FEIM) for the recognition of six basic facial expressions (anger, sad, fear, happy, surprise and disgust) plus one neutral emotion. The features are extracted by implementing an integrated Gabor and local binary pattern (LBP) feature extraction method and the concept of principal component analysis (PCA) is executed for feature selection. A deep neural network is trained for the facial expression research group database (FERG-DB) dataset to classify the facial expression images into seven emotion expression classes (anger, fear, disgust, happy, neutral, sad, and surprise). The effectiveness of the proposed system is manifested by comparing the recognition rate results with state-of-the-art-techniques. The overall results in terms of precision, recall and f-score also favours the efficacy of proposed method.

Keywords: facial expressions; deep learning; convolutional neural network; deep neural network; facial features; Gabor filter; principal component analysis; PCA; local binary pattern; LBP.

DOI: 10.1504/IJAIP.2023.135856

International Journal of Advanced Intelligence Paradigms, 2023 Vol.26 No.3/4, pp.362 - 391

Received: 20 Feb 2018
Accepted: 01 May 2018
Published online: 09 Jan 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article