Title: Real-time emotion detection from integrating electroencephalography, facial expressions and speech: review

Authors: Aaditi More; Joydeep Sengupta

Addresses: Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology Nagpur, Nagpur, India ' Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology Nagpur, Nagpur, India

Abstract: Emotion recognition systems have gained substantial focus due to their pivotal role in man-machine interaction and affective computing applications. This comprehensive literature survey explores the latest advancements in the field, spanning a different variety of strategies and datasets. Survey delves into realm of cross-corpus speech emotion identification, discussing innovative approaches including deep local domain adaptation and multimodal systems like RobinNet. Furthermore, it investigates electroencephalography-based emotion recognition techniques, highlighting hierarchical self-attention networks, deep forest models, and spatio-temporal convolution attention neural networks. The paper also presents collaborative frameworks for the diagnosis of sadness that makes use of cross-scale facial feature analysis and negative emotion detection. In realm of machine learning, ensemble approaches for affective computing and the efficacy of prompt consistency in multi-label textual emotion detection are examined. Through this survey, emerging trends, comparative studies, and validation frameworks in emotion recognition systems research are synthesised. The findings underscore the significance of these systems in knowing human emotions and creating the groundwork for next developments in affective computing.

Keywords: speech emotion recognition; electroencephalography-based emotion recognition; deep learning models; multimodal emotion recognition.

DOI: 10.1504/IJBET.2026.154168

International Journal of Biomedical Engineering and Technology, 2026 Vol.50 No.4, pp.317 - 346

Received: 09 Nov 2024
Accepted: 16 Mar 2025
Published online: 15 Jun 2026 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article