Title: Real-time structured light 3D scanning using colour stripes for hand tracking

Authors: Renju Li; Hongbin Zha

Addresses: Key Laboratory of Machine Perception, Peking University, Beijing 100871, China. ' Key Laboratory of Machine Perception, Peking University, Beijing 100871, China

Abstract: In this paper, we propose a real-time scanning system for hand tracking based on a novel stripe pattern. This pattern uses colour stripes with quadratic intensity distribution in each stripe. The colour distribution is based on a De Bruijn sequence with six colours and order three. Graph cut is utilised to decode the colour information and the resulting code is calculated using local intensity. As the proposed method uses one pattern only, real-time 3D reconstruction can be achieved. After camera and projector calibration, 3D data of a moving hand can be acquired using the real-time system. For each frame of the sequence, the fingertips are detected by making use of the boundary of the 3D precise data and the tracking results can be achieved by collision detection. Some experiments have been performed to evaluate the effectiveness of the proposed method.

Keywords: structured light; 3D shape recovery; real-time 3D scanning; hand tracking; virtual reality; stripe patterns; colour stripes; quadratic intensity distribution; De Bruijn sequence; graph cut; fingertip detection; collision detection.

DOI: 10.1504/IJMA.2012.050496

International Journal of Mechatronics and Automation, 2012 Vol.2 No.4, pp.262 - 269

Received: 29 Mar 2012
Accepted: 13 Jul 2012
Published online: 27 Nov 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article