Title: Medical student question answering behaviour during high-stakes multiple choice examinations

Authors: Tahra AlMahmoud; Dybesh Regmi; Margaret Elzubeir; Frank Christopher Howarth; Sami Shaban

Addresses: Department of Surgery, College of Medicine and Health Sciences, United Arab Emirates University, Al Ain, UAE ' Department of Family Medicine, College of Medicine & Health Sciences, United Arab Emirates University, Al Ain, UAE ' Department of Medical Education, College of Medicine and Health Sciences, United Arab Emirates University, Al Ain, UAE ' Department of Physiology, College of Medicine & Health Sciences, United Arab Emirates University, Al Ain, UAE ' Department of Medical Education, College of Medicine and Health Sciences, United Arab Emirates University, Al Ain, UAE

Abstract: Evaluating student answering behaviour during high-stakes assessments may help identify deficits in students' efficiency or question answering effectiveness. We used electronic assessment logfiles to examine student answering behaviour during exams. We compared the time spent on questions based on student gender, question correctness, cognitive level and clinical discipline. Male and female students spent the same amount of time on questions however, females performed significantly better. There were significant differences in average time spent on questions answered correctly versus incorrectly and in the amount of time examinees spent on questions per cognitive level. The percentage of questions that had answers changed by examinees was 13.65% of which 5.82% changed from incorrect to correct and 2.83% changed from correct to incorrect. On average, 16.3% of questions were placed under review by examinees at some time during the exam. Students spent significantly more time on questions that were answered incorrectly and on higher cognitive level questions. Reviewing and re-answering questions was more beneficial than harmful to student marks.

Keywords: assessment; multiple choice question; medical student; question answering behaviour; big data; logfile analysis; assessment management system.

DOI: 10.1504/IJTEL.2019.098777

International Journal of Technology Enhanced Learning, 2019 Vol.11 No.2, pp.157 - 171

Received: 04 Oct 2017
Accepted: 11 Mar 2018
Published online: 02 Apr 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article