Title: A novel figure panel classification and extraction method for document image understanding

Authors: Xiaohui Yuan; Dongyu Ang

Addresses: University of North Texas, Denton TX 76201, USA ' University of North Texas, Denton TX 76201, USA

Abstract: With the availability of full-text documents in many online databases, the paradigm of biomedical literature mining and document understanding has shifted to analysis of both text and figures to derive implicit messages that are unforeseen with text mining only. To enable automatic, massive processing, a key step is to extract and parse figures embedded in papers. In this paper, we present a novel model-driven, hierarchical method to classify and extract panels from figures in scientific papers. Our method consists of two integrated components: figure (or panel) classification and panel segmentation. Figure classification evaluates each panel and decides the existence of photographs and drawings. Mixtures of photographs and non-photographs are divided into subfigures. The splitting process repeats until no further panel collage can be identified. Detection of highlighted views is addressed with Hough space analysis. Using reconstruction from Hough peaks, enclosed panels are retrieved and saved into separate files. Experiments were conducted with a total of 360 figures extracted from two sets of papers that are retrieved with difference sets of keywords. Experimental results demonstrated that our method successfully segmented figures and extracted photographs and non-photographs with high accuracy and robustness. In addition, our method was able to identify zoom-in views that are superimposed on the original photographs. The efficiency of our method allows online implementation.

Keywords: image segmentation; document analysis; biomedical literature; text mining; literature mining; implicit messages; figures; figure panel classification; figure panel extraction; document understanding; scientific papers; photographs; drawings; information retrieval.

DOI: 10.1504/IJDMB.2014.057779

International Journal of Data Mining and Bioinformatics, 2014 Vol.9 No.1, pp.22 - 36

Received: 17 Feb 2012
Accepted: 02 Mar 2012

Published online: 21 Oct 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article