Title: Real-time voice-controlled human machine interface system for wheelchairs implementation using Raspberry Pi

Authors: Aymen Mnassri; Sihem Nasri; Mohammed Boussif; Adnane Cherif

Addresses: Department of Physics, Faculty of Sciences of Tunis El Manar, University of Tunis El Manar, Belvedere, Tunis, Tunisia ' Department of Physics, Faculty of Sciences of Tunis El Manar, University of Tunis El Manar, Belvedere, Tunis, Tunisia ' Department of Physics, Faculty of Sciences of Tunis El Manar, University of Tunis El Manar, Belvedere, Tunis, Tunisia ' Department of Physics, Faculty of Sciences of Tunis El Manar, University of Tunis El Manar, Belvedere, Tunis, Tunisia

Abstract: The article describes the development of a wheelchair prototype designed to facilitate the mobility of people with disabilities. The proposed system is based on voice commands to ensure communication between humans and machines. The system consists of two modules. The first module involves the detection, processing and classification of actual voice signals acquired from a mobile phone. This module incorporates a robust and excellent speech recognition strategy. Indeed, the combination of Mel Frequency Cepstral Coefficients (MFCC) and the Discrete Wavelet Transform (DWT) in signal processing and feature extraction allows for better performance, achieving an effective recognition rate of 100% for an SNR of 5 db. The second module presents the mechanical design and development of the actual prototype, which enables real-time simulation of the first module. This module is based on a Raspberry Pi 3 board with a Linux operating kernel. Finally, tests carried out on the designed wheelchair prototype have demonstrated its efficiency, robustness and excellent response to critical situations, particularly obstacles.

Keywords: wheelchair; speech recognition; HMI; human-machine-interface; real-time; Raspberry Pi; mobile phone.

DOI: 10.1504/IJVICS.2024.136273

International Journal of Vehicle Information and Communication Systems, 2024 Vol.9 No.1, pp.81 - 102

Received: 21 Oct 2022
Accepted: 02 Aug 2023

Published online: 25 Jan 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article