Title: Online vs. written multiple-choice questions tests: accuracy and usefulness

Authors: Tomislav Petkovic, Zvonko Kostanjcar, Ana Sovic

Addresses: University of Zagreb, Faculty of Electrical Engineering and Computing, Department of Electronic Systems and Information Processing, Unska 3, 10000 Zagreb, Croatia. ' University of Zagreb, Faculty of Electrical Engineering and Computing, Department of Electronic Systems and Information Processing, Unska 3, 10000 Zagreb, Croatia. ' University of Zagreb, Faculty of Electrical Engineering and Computing, Department of Electronic Systems and Information Processing, Unska 3, 10000 Zagreb, Croatia

Abstract: With the online resources becoming common, one can ask what the limitations are when applied to online examinations. Standardised multiple-choice questions (MCQs) test are commonly used either as a tool to enable student self-examination or as a tool to test large number of students in a more efficient way. However, the means of delivery and what one intends the tests to measure should be carefully considered. During last two years in teaching, the course |Signals and Systems|, both online and written, proctored and non-proctored, MCQs test were used in production environment (in vivo). Obtained data suggest that test delivery method strongly influences test accuracy when measuring the knowledge students gained. Online non proctored delivery, although being the simplest, yields strongly biased results and is suitable only as a tool to enable student self-assessment of the gained knowledge, while the online or written (non-strictly) proctored tests are still the method of choice if one wants to objectively measure the knowledge gained by students.

Keywords: e-learning; MCQ test; student assessment; multiple choice tests; multiple-choice questions; knowledge assessment; electronic learning; online learning; written tests; online tests; higher education; university students.

DOI: 10.1504/IJIDSS.2010.033680

International Journal of Intelligent Defence Support Systems, 2010 Vol.3 No.1/2, pp.101 - 115

Published online: 15 Jun 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article