Int. J. of Arts and Technology   »   2008 Vol.1, No.2

 

 

Title: Gesture recognition in virtual reality

 

Author: Manolya Kavakli

 

Address: Virtual and Interactive Simulations of Reality (VISOR) Research Group, Department of Computing, Macquarie University, Sydney, NSW 2109, Australia

 

Abstract: In this paper, our purpose is to investigate the system architectures and thresholds to detect gestures for a gesture-based system. We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows real-time dynamic interaction with an object to perform a number of design operations, controlling 1 LED and wearing Datagloves. DRive allows a quadriplegic person to control a car interface taking input from 2 LEDs and shoulder movements only, wearing a garment with 2 LEDs. We developed an interface using a stereoscopic display (VISOR) and various motion capture systems integrating Vizard Virtual Reality Toolkit, an optical tracking system, datagloves, and a sensor-based jacket. In this paper, we describe a generic system architecture for gesture detection and present an approach to represent the finger states using binary digits. We have found this approach is sufficient enough and have not detected any specific delays in the detection of gestures using different input systems.

 

Keywords: gesture recognition; human-computer interaction; HCI; motion tracking; sketching; virtual reality; gestures; real-time interaction; dynamic interaction; design process; disabled; quadriplegic; automotive control; stereoscopic display; motion capture; datagloves; sensor-based jacket; finger states; disability; hand motions; vehicle control.

 

DOI: 10.1504/IJART.2008.021928

 

Int. J. of Arts and Technology, 2008 Vol.1, No.2, pp.215 - 229

 

Available online: 09 Dec 2008

 

 

Editors Full text accessAccess for SubscribersPurchase this articleComment on this article