Title: Dynamic facial expression analysis based on extended spatio-temporal histogram of oriented gradients

Authors: Seyedehsamaneh Shojaeilangari; Wei-Yun Yau; Jun Li; Eam-Khwang Teoh

Addresses: School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Ave., S1-B4c-14, 639798, Singapore ' Institute for Infocomm Research, A*STAR, 1 Fusionopolis Way, #21-01 Connexis South, 138632, Singapore ' Institute for Infocomm Research, A*STAR, 1 Fusionopolis Way, #21-01 Connexis South, 138632, Singapore ' School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Ave., S2-B2b-64, 639798, Singapore

Abstract: Facial expression is crucial for proper analysis of a person's face. It is an indicator of the emotion of a person and thus has attracted the attention of many researchers. In this work, a novel local spatio-temporal descriptor is proposed for motion pattern detection. The proposed feature comprises histogram of 3D gradients and the gradients' variation over time to robustly describe the spatial and temporal information. It also incorporates spatio-temporal pyramid structure to handle different resolution and frame rate. To reduce the dimension of the feature, we applied genetic algorithm for region-based feature selection. We evaluated the performance of our proposed descriptors on facial expression recognition using the Cohn-Kanade (CK+) database. The experimental results achieved 96.10% accuracy in detecting six basic emotions. The key advantages of our proposed method are: local and dynamic processing, simple implementation, high performance, and robustness to variation of video resolution or temporal sampling rate.

Keywords: emotion recognition; facial expression; spatio-temporal pyramid; genetic algorithms; spatio-temporal histogram of oriented gradient; biometrics; motion pattern detection; expression recognition; emotions.

DOI: 10.1504/IJBM.2014.059640

International Journal of Biometrics, 2014 Vol.6 No.1, pp.33 - 52

Received: 09 May 2013
Accepted: 02 Oct 2013

Published online: 04 Mar 2014 *

Full-text access for editors Access for subscribers Purchase this article Comment on this article