Title: Evaluating learning algorithms and classifiers

Authors: Niklas Lavesson, Paul Davidsson

Addresses: Department Software and Systems Engineering, School of Engineering, Blekinge Institute of Technology, Box 520, SE-372 25 Ronneby, Sweden. ' Department Software and Systems Engineering, School of Engineering, Blekinge Institute of Technology, Box 520, SE-372 25 Ronneby, Sweden

Abstract: We analyse 18 evaluation methods for learning algorithms and classifiers, and show how to categorise these methods with the help of an evaluation method taxonomy based on several criteria. We also define a formal framework that make it possible to describe all methods using the same terminology, and apply it in a review of the state-of-the-art in learning algorithm and classifier evaluation. The framework enables comparison and deeper understanding of evaluation methods from different fields of research. Moreover, we argue that the framework and taxonomy support the process of finding candidate evaluation methods for a particular problem.

Keywords: classification; evaluation methods; taxonomy; supervised learning; learning algorithms; classifiers.

DOI: 10.1504/IJIIDS.2007.013284

International Journal of Intelligent Information and Database Systems, 2007 Vol.1 No.1, pp.37 - 52

Published online: 19 Apr 2007 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article