Title: 3V-JMLE: a three-valued score matrix-based joint parameter estimation algorithm in computerised adaptive testing

Authors: Hong Zhou; Jiale Zhou; Xiaoqing Gu; Hongjiao Liu; Xiaoyu Yang

Addresses: e-Educational System Engineering Research Centre & Shanghai Engineering Research Centre of Digital Education Equipment, East China Normal University, Shanghai, China; Department of Educational Information Technology, East China Normal University, Shanghai, China ' e-Educational System Engineering Research Centre & Shanghai Engineering Research Centre of Digital Education Equipment, East China Normal University, Shanghai, China; Department of Educational Information Technology, East China Normal University, Shanghai, China ' e-Educational System Engineering Research Centre & Shanghai Engineering Research Centre of Digital Education Equipment, East China Normal University, Shanghai, China; Department of Educational Information Technology, East China Normal University, Shanghai, China ' Shanghai South West Weiyu Middle School, Shanghai, China ' Department of Educational Information Technology, East China Normal University, Shanghai, China

Abstract: During the development of a Computerised Adaptive Testing (CAT) system, certain inadequacies were found in the popular Joint Maximum Likelihood Estimation (JMLE) algorithm utilised to acquire the ideal binary score matrix. When we attempted to acquire a question-response matrix from a traditional online test item pool system, more than 90% response elements were NA in the matrix. An ideal binary score matrix could scarcely be derived from it. Thus, we proposed a revised algorithm named three-valued JMLE (3V-JMLE) in this paper. When the response could not generate an ideal binary score matrix, we can transform the non-ideal binary matrix into a three-valued score matrix, and the parameters can be estimated simply by using 3V-JMLE. Experiment results show that 3V-JMLE has the same estimation accuracy and computational efficiency as JMLE. In addition, 3V-JMLE has an extensive range of applications and high testing efficiency.

Keywords: joint parameter estimation method; ideal binary score matrix; three-valued score matrix; computerised adaptive testing system; item response theory; logistic model.

DOI: 10.1504/IJSMARTTL.2020.109492

International Journal of Smart Technology and Learning, 2020 Vol.2 No.1, pp.48 - 65

Received: 14 Nov 2018
Accepted: 29 Nov 2019
Published online: 10 Sep 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article