Title: Improving understandability of semantic search explanations

Authors: Thomas Roth-Berghofer, Bjorn Forcher

Addresses: Knowledge Management Department, German Research Center for Artificial Intelligence (DFKI) GmbH, Trippstadter Strasse 122, Kaiserslautern, 67663, Germany; Knowledge-Based Systems Group, Department of Computer Science, University of Kaiserslautern, P.O. Box 3049, Kaiserslautern, 67653, Germany. ' Knowledge Management Department, German Research Center for Artificial Intelligence (DFKI) GmbH, Trippstadter Strasse 122, Kaiserslautern, 67663, Germany

Abstract: Explanation-aware software design aims at making software systems smarter in interactions with their users. The long-term goal is to provide methods and tools for systematically engineering understandability into the respective (knowledge-based) software system. In this paper, we describe how we improved a semantic search engine, i.e., RadSem, regarding understandability. The research project MEDICO aims at developing an intelligent, robust and scalable semantic search engine for medical documents. RadSem is based on formal ontologies and designated for different kinds of users. Since semantic search results are often hard to understand, an explanation facility for justifying and exploring search results was integrated into RadSem employing the same ontologies used for searching also for explanation generation. We evaluated the understandability of selected concept labels in an experiment with different user groups using semantic networks as form of depicting explanations and using a class frequency approach for selecting appropriate labels.

Keywords: understandability; knowledge engineering; justification; graphical explanation; semantic search; evaluation; medical terms; medical documents; ontologies; explanation-aware software design; annotation; document retrieval; information retrieval.

DOI: 10.1504/IJKEDM.2011.037644

International Journal of Knowledge Engineering and Data Mining, 2011 Vol.1 No.3, pp.216 - 234

Published online: 07 Mar 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article