Title: Reliability and variability in facial electromyography for identification of speech and for human computer control: an experimental study

Authors: Sridhar Poosapadi Arjunan; Hans Weghorn; Dinesh Kant Kumar

Addresses: School of Electrical Engineering, RMIT University, GPO Box 2476V, Melbourne, Victoria 3001, Australia. ' Mechatronics Department, Baden-Wurttemberg – University of Cooperative Education, Jägerstrasse 58, D-70174 Stuttgart, Germany. ' School of Electrical Engineering, RMIT University, GPO Box 2476V, Melbourne, Victoria 3001, Australia

Abstract: The need for developing reliable and flexible human computer interface is increased and applications of HCI have been in each and every field. Human factors play important role in these kinds of interfaces. This research investigates the use of facial muscle activity for a reliable interface to identify voiceless speech-based commands without any audio signals. We propose a method of measuring the relative activity of the articulatory muscles of the face for recognition of unvoiced vowels. System performance and reliability were also tested for the case of variations like inter-subject, inter-day, and different languages. In these investigations, English vowels and German vowels were used as recognition variables. The designed methodology used linear and non-linear classification based on statistical clustering techniques and artificial neural network architecture. The results show that there is a variability in facial muscle activation during vowel utterance between different subjects, different days. These results will be helpful in use of facial electromyography for identification of speech and in other application such as human computer control.

Keywords: human factors; reliability; speech recognition; human-computer interface; HCI; facial movement; surface electromyography; EMG; biosignal processing; signal processing; facial electromyography; facial muscles; unvoiced vowels; English; German; clustering; artificial neural networks; ANNs; vowel utterance; biometrics.

DOI: 10.1504/IJMEI.2011.044746

International Journal of Medical Engineering and Informatics, 2011 Vol.3 No.4, pp.311 - 330

Published online: 07 Mar 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article