Title: A methodology for evaluating web-based educational systems using statistical multidimensional analysis

Authors: George Zardas; Odysseas Moschidis; Ioannis Mavridis; Athanasios Manitsaris

Addresses: Department of Applied Informatics, University of Macedonia, 156 Egnatia Str, Thessaloniki 540 06, Greece. ' Department of Marketing and Operation Management, University of Macedonia, 156 Egnatia Str, Thessaloniki 540 06, Greece. ' Department of Applied Informatics, University of Macedonia, 156 Egnatia Str, Thessaloniki 540 06, Greece. ' Department of Applied Informatics, University of Macedonia, 156 Egnatia Str, Thessaloniki 540 06, Greece

Abstract: Current research on web-based learning systems focuses on providing adaptation as part of usability and learnability aspects of these systems. Working in this direction, the (asynchronous adaptive learning and evaluation system) has been developed, which provides new opportunities to the transfer of knowledge between educators and learners by widely incorporating pedagogical principles in order to enhance the effectiveness of the learning procedure. This paper aims to provide an approach on evaluating the impact of adaptivity, usability and learnability based on Nielsen's ten usability heuristics (Nielsen, 1993b) on improving the effectiveness of users' learning in web-based courses. For this purpose, a new evaluation methodology is presented that utilises the statistical method of multidimensional analysis (correspondence analysis) and uses special contingency tables that came from a new coding of scales evaluation. To demonstrate the applicability and effectiveness of the proposals, the evaluation methodology is implemented to the web-based educational system AS.A.L.E.S., resulting in highlighting the characteristics of the AS.A.L.E.S. system that need to be improved.

Keywords: AHES; adaptivity; learnability; usability; correspondence analysis; statistical multidimensional analysis; learning systems evaluation; web-based learning; e-learning; electronic learning; online learning.

DOI: 10.1504/IJLT.2011.044631

International Journal of Learning Technology, 2011 Vol.6 No.4, pp.409 - 432

Published online: 20 Oct 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article