Article: Incremental approach for multi-modal face expression recognition system using deep neural networks Journal: International Journal of Computational Vision and Robotics (IJCVR) 2021 Vol.11 No.1 pp.1 - 20 Abstract: Facial expression recognition (FER) is still one of the most challenging tasks. Convolutional neural network (CNN) and deep convolutional neural network (DCNN) has evolved as an efficient tool for FER models, but they differ significantly in terms of their network configuration and architecture. There exists a variety of bottlenecks in existing FER systems, such as they lack in generalising their algorithms. In this paper, we propose a model based on DCNN to overcome these challenges. Firstly, the proposed model focuses on the selection of an appropriate activation function depending on its accuracy and training loss over a database. Secondly, an incremental strategy is used in which deeper models are developed simultaneously from shallower networks to increase the accuracy with less training loss. Lastly, by an ensemble of CNN and DCNNs, the model achieves an accuracy of 74.15% for FER2013, 96.20% for CK+, and 98.25% for JAFFE databases, outperforming previous work. Inderscience Publishers - linking academia, business and industry through research

Title: Incremental approach for multi-modal face expression recognition system using deep neural networks

Authors: Anand Handa; Rashi Agarwal; Narendra Kohli

Addresses: Department of Computer Science and Engineering, Dr. APJ Abdul Kalam Technical University, Lucknow, India ' Department of Information Technology, University Institute of Engineering and Technology, CSJM University, Kanpur, India ' Department of Computer Science and Engineering, Harcourt Butler Technical University, Kanpur, India

Abstract: Facial expression recognition (FER) is still one of the most challenging tasks. Convolutional neural network (CNN) and deep convolutional neural network (DCNN) has evolved as an efficient tool for FER models, but they differ significantly in terms of their network configuration and architecture. There exists a variety of bottlenecks in existing FER systems, such as they lack in generalising their algorithms. In this paper, we propose a model based on DCNN to overcome these challenges. Firstly, the proposed model focuses on the selection of an appropriate activation function depending on its accuracy and training loss over a database. Secondly, an incremental strategy is used in which deeper models are developed simultaneously from shallower networks to increase the accuracy with less training loss. Lastly, by an ensemble of CNN and DCNNs, the model achieves an accuracy of 74.15% for FER2013, 96.20% for CK+, and 98.25% for JAFFE databases, outperforming previous work.

Keywords: activation functions; deep neural network; DNN; convolutional neural network; CNN; feature extraction; feature classification; machine learning; image processing; computer vision; facial expressions; ensemble; facial expression recognition; FER.

DOI: 10.1504/IJCVR.2021.111881

International Journal of Computational Vision and Robotics, 2021 Vol.11 No.1, pp.1 - 20

Received: 21 Nov 2018
Accepted: 21 Sep 2019
Published online: 18 Dec 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: Incremental approach for multi-modal face expression recognition system using deep neural networks

Keep up-to-date