Title: Evaluation criteria for information quality research

Authors: Philip Woodall; Alexander Borek; Ajith Kumar Parlikad

Addresses: Department of Engineering, Institute for Manufacturing, University of Cambridge, 17 Charles Babbage Road, Cambridge, UK ' Gartner Deutschland GmbH, Lehrer-Wirth-Straße 2, 81829 München, Germany ' Department of Engineering, Institute for Manufacturing, University of Cambridge, 17 Charles Babbage Road, Cambridge, UK

Abstract: Evaluation of research artefacts (such as models, frameworks and methodologies) is essential to determine their quality and demonstrate worth. However, in the information quality (IQ) research domain there is no existing standard set of criteria available for researchers to use to evaluate their IQ artefacts. This paper therefore describes our experience of selecting and synthesising a set of evaluation criteria used in three related research areas of information systems (IS), software products (SP) and conceptual models (CM), and analysing their relevance to different types of IQ research artefact. We selected and used a subset of these criteria in an actual evaluation of an IQ artefact to test whether they provide any benefit over a standard evaluation. The results show that at least a subset of the criteria from the other domains of IS, SP and CM are relevant for IQ artefact evaluations, and the resulting set of criteria, most importantly, enabled a more rigorous and systematic selection of what to evaluate.

Keywords: data quality; information quality; quality evaluation; evaluation criteria; IQ artefacts; DQ artefacts; information systems; software products; conceptual models.

DOI: 10.1504/IJIQ.2016.083125

International Journal of Information Quality, 2016 Vol.4 No.2, pp.124 - 148

Accepted: 21 Jan 2016
Published online: 21 Mar 2017 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article