Parameter recovery of a cognitive diagnostic model: evidence from a simulation study
by Roofia Galeshi; Gary Skaggs
International Journal of Quantitative Research in Education (IJQRE), Vol. 3, No. 4, 2016

Abstract: Although item response theory is a valuable summative assessment tool, cognitive diagnostic models could potentially be a valuable instructional and formative assessment instrument. Using simulation methods, we have examined one of the existing additive models - the compensatory reparameterised unified model (CRUM) - for its parameter recovery and classification accuracy under various research designs. In order for models such as the CRUM to be useful, it is essential to establish their parameter recovery and classification accuracy. This study simulated data for sample sizes of 50, 100, 500, 1,000, 5,000, and 10,000 examinees with various attribute-item combinations: 7 items with 3 attributes, 15 items with 4 attributes, 31 items with 5 attributes, and 35 items with 3 attributes to be evaluated for its parameter recovery. The results suggest that the accuracy of measuring examinees' attribute mastery depends heavily on the combination of the number of items and attributes as well as the sample size. Item parameter estimation was almost equally accurate for datasets of sample sizes greater than 100. The more complex items required larger sample sizes to maintain its consistency of parameter estimation.

Online publication date: Wed, 22-Feb-2017

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Quantitative Research in Education (IJQRE):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com