Title: A relevance feedback-based learner for image retrieval using SIFT descriptors

Authors: Subrahmanyam Murala, R.P. Maheshwari, R. Balasubramanian

Addresses: Instrumentation and Signal Processing Laboratory, Department of Electrical Engineering, Indian Institute of Technology Roorkee, Roorkee 247667, Uttarakhand, India. ' Department of Electrical Engineering, Indian Institute of Technology Roorkee, Roorkee 247667, Uttarakhand, India. ' Department of Mathematics, Indian Institute of Technology Roorkee, Roorkee 247667, Uttarakhand, India

Abstract: This paper presents a relevance feedback (RF) algorithm for scale invariant features extracting form Caltech image database. The RF is a powerful technique to bridging the gap between high-level concepts and low-level features in image retrieval systems. This paper attempts to enhance the performance of RF by exploiting unlabelled images in the database. Each scale invariant feature transform (SIFT) keypoint is considered as the different feature (colour histogram, colour moments, wavelet transform, Gabor transform, etc.). The user labels several images accordingly to whether they are positive (relevant) or negative (irrelevant) examples to a query. Therefore, the relevance feedback process changes labelled and unlabelled images. The query feature and weights are updated as per the keypoint features of positively and negatively labelled images. Furthermore, a new similarity measurement for matching of database images with query is proposed in this paper. The SIFT feature is local feature of an image, which is invariant to image scaling, transformation, rotation and partially invariant to illumination changes, angle of view changes, and noise. The retrieval results show that proposed RF method using SIFT descriptors achieves good effectiveness in content-based image retrieval.

Keywords: scale invariant feature transform; SIFT; relevance feedback; content-based image retrieval; CBIR; keypoint descriptors; unlabelled images; similarity measures.

DOI: 10.1504/IJCVR.2011.042269

International Journal of Computational Vision and Robotics, 2011 Vol.2 No.2, pp.99 - 114

Published online: 02 Sep 2011 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article