Title: Real-time automatic tracking of hand motion in RGB videos using local feature SIFT

Authors: Richa Golash; Yogendra Kumar Jain

Addresses: Samrat Ashok Technological Institute, Vidisha, MP, 464001, India ' Samrat Ashok Technological Institute, Vidisha, MP, 464001, India

Abstract: This paper proposes a method for real-time visual tracking of moving hand in RGB videos without any segmentation process and background subtraction. We have used YC_gC_r converted version of YC_bC_r colour space for a more compact representation of the initial region of moving hand and then local feature SIFT to detect and track hand simultaneously. YC_gC_r has a high tendency for skin colour accretion and can effectively discriminate between the skin and non-skin colour regions. The approach demonstrates that using local features (SIFT) of only active region reduces the computation as well as make the method free from the challenges of freedom factor of hand and thus the methodology can detect the hand of any shape and size without being affected by background conditions. In general, researchers avoid using a normal camera for applications based on hand tracking, as RGB images are sensitive to illumination. Our work exhibits that the combination of YC_gC_r and two-stage feature matching through SIFT algorithm is successful in tracking non-rigid objects with less computation. The methodology is further evaluated with Kalman tracking in hand gesture recognition and is also compared with contemporary works.

Keywords: hand gesture recognition; HGR; feature extraction; scale invariant feature transform; SIFT; Kalman filter; tracking.

DOI: 10.1504/IJISDC.2020.115175

International Journal of Intelligent Systems Design and Computing, 2020 Vol.3 No.2, pp.161 - 177

Received: 11 Apr 2020
Accepted: 04 Dec 2020
Published online: 21 May 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article