Article: A novel approach for gesture control video games based on perceptual features: modelling, tracking and recognition Journal: International Journal of Computational Vision and Robotics (IJCVR) 2012 Vol.3 No.1/2 pp.75 - 95 Abstract: Gesture recognition has been an attractive research area for decades. Recently, the video game industry has become the major driving force for the development of advanced gesture control technologies. Conventional video games are controlled via physical devices. In contrast, the emerging trend is using camera-based human computer interface (HCI) to capture human gestures and control game playing directly. This paper presents a novel approach for facilitating the development of gesture control-based video games. A time-of-flight (TOF) camera is adopted to provide both depth and greyscale image sequences. 3D perceptual gesture features are extracted and grouped into a generic gesture representation for target gesture recognition. The game control parameters are derived from the recognised gestures on the fly. This framework includes five key modules: 1) perceptual feature extraction; 2) object tracking by perceptual grouping; 3) representation and modelling; 4) gesture recognition; 5) game control parameter generation. A proof-of-concept dart game is implemented for demonstration and evaluation. Inderscience Publishers - linking academia, business and industry through research

Title: A novel approach for gesture control video games based on perceptual features: modelling, tracking and recognition

Authors: Gang Hu; Qigang Gao

Addresses: Faculty of Computer Science, Dalhousie University, 6050 University Avenue, Halifax, NS, B3H 1W5, Canada. ' Faculty of Computer Science, Dalhousie University, 6050 University Avenue, Halifax, NS, B3H 1W5, Canada

Abstract: Gesture recognition has been an attractive research area for decades. Recently, the video game industry has become the major driving force for the development of advanced gesture control technologies. Conventional video games are controlled via physical devices. In contrast, the emerging trend is using camera-based human computer interface (HCI) to capture human gestures and control game playing directly. This paper presents a novel approach for facilitating the development of gesture control-based video games. A time-of-flight (TOF) camera is adopted to provide both depth and greyscale image sequences. 3D perceptual gesture features are extracted and grouped into a generic gesture representation for target gesture recognition. The game control parameters are derived from the recognised gestures on the fly. This framework includes five key modules: 1) perceptual feature extraction; 2) object tracking by perceptual grouping; 3) representation and modelling; 4) gesture recognition; 5) game control parameter generation. A proof-of-concept dart game is implemented for demonstration and evaluation.

Keywords: gesture control; video games; video game interfaces; time-of-flight; TOF 3D camera; perceptual feature extraction; object tracking; tracking; perceptual grouping; gesture representation; modelling; gesture recognition; human-computer interface; HCI; human gestures; image sequences.

DOI: 10.1504/IJCVR.2012.046416

International Journal of Computational Vision and Robotics, 2012 Vol.3 No.1/2, pp.75 - 95

Published online: 04 Sep 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: A novel approach for gesture control video games based on perceptual features: modelling, tracking and recognition

Keep up-to-date