Title: Hierarchical key frame extraction for wireless capsule endoscopy video based on the saliency map

Authors: Yixuan Yuan; Max Q-H. Meng

Addresses: Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong ' Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong

Abstract: Wireless capsule endoscopy (WCE) is a non-invasive imaging technique to examine the entire small intestine. This paper presents a novel hierarchical key frame extraction algorithm based on the saliency map to automatically select a small number of key informative frames in the WCE video to assist the diagnostic process. We start from calculating the saliency map and extracting the inside colour, texture and shape features. We then compute the image information entropies with adapted weights on three features; calculate the differences of entropies in the successive frames and extract the first level key frames to divide the video into multi-segments. Finally, the mean shift clustering method is applied on each segment to obtain the final key frames. The proposed technique achieves the fidelity of 95.07% and the compression ratio of 87.9% on average, validating that the proposed scheme is highly promising for the key frame extraction in the WCE video.

Keywords: wireless capsule endoscopy; WCE video; hierarchical key frame extraction; saliency map; adapted weights; information entropy; mean shift clustering; non-invasive imaging; small intestine; feature extraction; texture features; shape features; colour features.

DOI: 10.1504/IJMA.2014.066383

International Journal of Mechatronics and Automation, 2014 Vol.4 No.4, pp.259 - 268

Received: 05 Nov 2013
Accepted: 08 Sep 2014

Published online: 14 Jan 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article