Title: Using textual and structural context for searching Multimedia Elements

Authors: Mouna Torjmen, Karen Pinel-Sauvagnat, Mohand Boughanem

Addresses: IRIT-SIG, University of Toulouse, 118 route de Narbonne, 31062 Toulouse Cedex 4, France. ' IRIT-SIG, University of Toulouse, 118 route de Narbonne, 31062 Toulouse Cedex 4, France. ' IRIT-SIG, University of Toulouse, 118 route de Narbonne, 31062 Toulouse Cedex 4, France

Abstract: We investigate in this paper the use of XML structure in multimedia retrieval, particularly in context-based image retrieval. We propose two methods to represent multimedia objects: the first one is based on an implicit use of textual and structural context of multimedia objects, whereas the second one is based on an explicit use of both sources. Experimental evaluation is carried out using the INEX MultimediaFragments Task 2006 and 2007. We show that there is a strong vocabulary relation between the query and the multimedia object representation, and that using XML structure improves significantly the effectiveness of multimedia retrieval.

Keywords: XML documents; context-based multimedia retrieval; hierarchical structures; multimedia elements; textual contexts; structural contexts; image retrieval; multimedia objects; implicit use; explicit use; experimental evaluation; INEX; MultimediaFragments Tasks; fragments; vocabulary relations; query; queries; object representation; effectiveness; XML streams; querying; extensible markup language; data mining; business intelligence.

DOI: 10.1504/IJBIDM.2010.036123

International Journal of Business Intelligence and Data Mining, 2010 Vol.5 No.4, pp.323 - 352

Published online: 22 Oct 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article