Title: Gesture recognition in virtual reality

Authors: Manolya Kavakli

Addresses: Virtual and Interactive Simulations of Reality (VISOR) Research Group, Department of Computing, Macquarie University, Sydney, NSW 2109, Australia

Abstract: In this paper, our purpose is to investigate the system architectures and thresholds to detect gestures for a gesture-based system. We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows real-time dynamic interaction with an object to perform a number of design operations, controlling 1 LED and wearing Datagloves. DRive allows a quadriplegic person to control a car interface taking input from 2 LEDs and shoulder movements only, wearing a garment with 2 LEDs. We developed an interface using a stereoscopic display (VISOR) and various motion capture systems integrating Vizard Virtual Reality Toolkit, an optical tracking system, datagloves, and a sensor-based jacket. In this paper, we describe a generic system architecture for gesture detection and present an approach to represent the finger states using binary digits. We have found this approach is sufficient enough and have not detected any specific delays in the detection of gestures using different input systems.

Keywords: gesture recognition; human-computer interaction; HCI; motion tracking; sketching; virtual reality; gestures; real-time interaction; dynamic interaction; design process; disabled; quadriplegic; automotive control; stereoscopic display; motion capture; datagloves; sensor-based jacket; finger states; disability; hand motions; vehicle control.

DOI: 10.1504/IJART.2008.021928

International Journal of Arts and Technology, 2008 Vol.1 No.2, pp.215 - 229

Published online: 09 Dec 2008 *

Full-text access for editors Access for subscribers Purchase this article Comment on this article