Title: Recognition of emotional states in response to audio-visual inductions based on nonlinear analysis and self-organisation map classification

Authors: Sepideh Hatamikia; Ali Motie Nasrabadi

Addresses: Department of Biomedical Engineering, Shahed University, Tehran, Iran ' Department of Biomedical Engineering, Shahed University, Tehran, Iran

Abstract: Recently, emotion recognition using biological signals has attracted much attention by researchers due to the rapid development of machine learning algorithms and various applications of brain computer interface (BCI). This study addresses the emotion recognition system from electroencephalogram signals, in which different emotional states are represented on the valence and arousal dimensions. As regards to nonlinear nature and complex dynamics of EEG signals, we propose to use nonlinear features from brain electrical activity to evaluate emotional states. With this aim, we examined two different categories of nonlinear features: fractal-based features and entropy-based features. In addition to that, a two stage feature selection based on Dunn index and sequential forward feature selection (SFS) algorithm is employed for eliminating redundant and weak features, and finally SOM classifier was applied to selected features in order to classification of emotional classes. The experimental results show that the proposed method can represent user's emotional state effectively in both two-level and four-level of valence and arousal dimension. Furthermore, we determined the best channels and time segments for discriminating the emotions and the most related regions of brain to emotion-related sensory activities were found.

Keywords: emotion recognition; electroencephalograms; EEG signals; valence; arousal; Dunn index; self-organising maps; SOM; audio-visual inductions; AV inductions; nonlinear features; fractal-based features; entropy-based features; feature selection; classification; emotional state.

DOI: 10.1504/IJMEI.2017.083090

International Journal of Medical Engineering and Informatics, 2017 Vol.9 No.2, pp.110 - 133

Received: 03 Sep 2015
Accepted: 08 Jun 2016
Published online: 20 Mar 2017 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article