Title: A two-camera-based vision system for image feature identification, feature tracking and distance measurement by a mobile robot

Authors: Avishek Chatterjee; N. Nirmal Singh; Olive Ray; Amitava Chatterjee; Anjan Rakshit

Addresses: Department of Electrical Engineering, Jadavpur University, Kolkata, PIN-700032, India. ' Department of Electrical Engineering, Jadavpur University, Kolkata, PIN-700032, India. ' Department of Electrical Engineering, Jadavpur University, Kolkata, PIN-700032, India. ' Department of Electrical Engineering, Jadavpur University, Kolkata, PIN-700032, India. ' Department of Electrical Engineering, Jadavpur University, Kolkata, PIN-700032, India

Abstract: This paper presents a two-camera-based vision system for image feature selection, tracking of the selected features and the calculation of 3D distance of the selected features. The feature tracking approach is based on minimisation of the sum of squared intensity differences between the past and the current window, which determines whether a current window is a warped version of the past window. The 3D positions of these features can be calculated on the basis of the known image coordinates of the same point/window in the left and right camera images. The distance calculation is carried out by employing 'midpoint of closest approach'. The vision system with the controlling architecture is implemented with the KOALA mobile robot. The system has been tested for real life environment in our laboratory and the experiments showed that the system can reliably detect features and track in subsequent frames and the 3D distances calculated for tracked features showed satisfactory accuracy.

Keywords: computer vision; mobile robots; robot vision; image features; feature identification; feature tracking; distance measurement.

DOI: 10.1504/IJIDSS.2011.044806

International Journal of Intelligent Defence Support Systems, 2011 Vol.4 No.4, pp.351 - 367

Published online: 28 Feb 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article