Title: An investigation on visual and audiovisual stimulus based emotion recognition using EEG

Authors: M. Murugappan, Mohd Rizon Bin Mohammed Juhari, Ramachandran Nagarajan, Sazali Yaacob

Addresses: School of Mechatronics Engineering, Universiti Malaysia Perlis (UniMAP), 02600, Jeajwi, Perlis, Kangar, Malaysia. ' Universiti Malaysia Perlis (UniMAP), 02600, Jejawi, Perlis, Kangar, Malaysia. ' Universiti Malaysia Perlis (UniMAP), 02600, Jejawi, Perlis, Kangar, Malaysia. ' Universiti Malaysia Perlis (UniMAP), 02600, Jejawi, Perlis, Kangar, Malaysia

Abstract: In this paper, we investigate the possibility of using visual and audio visual stimulus for detecting the human emotion by measuring electroencephalogram (EEG). Visual and audiovisual stimulus based protocols is designed to acquire the EEG signals over five healthy subjects using 63 biosensors. We propose the analysis of EEG signals using discrete wavelet transform and classification using neural network. EEG signals were decomposed into five frequency sub-bands using |db4| wavelet function and two statistical features were extracted from the alpha band. These statistical features were used as input to the neural network for classifying five emotions (disgust, happy, surprise, sad and anger). In the experiments of recognising human emotions from visual and audiovisual stimulus, the average recognition rate of 56.66% and 66.67% is obtained. The experimental result shows that the audiovisual stimulus based emotion recognition gives better classification accuracy over visual stimulus.

Keywords: electroencephalogram; EEG; human emotions; wavelet transform; WT; neural networks; emotion recognition; visual stimulus; audio-visual stimulus; biosensors.

DOI: 10.1504/IJMEI.2009.022645

International Journal of Medical Engineering and Informatics, 2009 Vol.1 No.3, pp.342 - 356

Published online: 22 Jan 2009 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article