Title: The promise of simulation-based science assessment: the Calipers project

Authors: Edys S. Quellmalz, Michael J. Timms, Barbara Buckley

Addresses: Math, Science and Technology Program, WestEd, 400 Seaport Court, Suite 222, Redwood City, CA 94063, USA. ' Math, Science and Technology Program, WestEd, 400 Seaport Court, Suite 222, Redwood City, CA 94063, USA. ' Math, Science and Technology Program, WestEd, 400 Seaport Court, Suite 222, Redwood City, CA 94063, USA

Abstract: The Calipers project developed and studied a new generation of simulation-based assessment systems. The project aimed to demonstrate the potential of technology- and simulation-based assessments to provide high-quality evidence of complex performances for science tests that address accountability or formative goals. End-of-unit, benchmark assessments for the topics of ecosystems and for forces and motion were developed to test national science standards at the middle school and secondary levels. Technical quality evidence documented the alignment of the assessments with national science standards, expert reviews of content and item quality, cognitive analyses of students thinking-aloud, and analyses of teacher and student data gathered from classroom pilot testing. The project broke new ground in harnessing the affordances of technology to transform what, how, when and where science learning is assessed and to gather evidence of students| connected science knowledge and extended inquiry not well measured by traditional paper-based tests.

Keywords: simulation-based assessments; science assessments; Calipers project; USA; United States; science tests; accountability; formative goals; end-of-unit assessments; benchmark assessments; ecosystems; forces and motion; national science standards; middle schools; secondary education; technical quality evidence; assessment alignment; expert reviews; content quality; item quality; cognitive analyses; thinking-aloud; teacher data; student data; classrooms; pilot testing; science knowledge; extended inquiry; paper-based tests; learning technology.

DOI: 10.1504/IJLT.2010.037306

International Journal of Learning Technology, 2010 Vol.5 No.3, pp.243 - 263

Published online: 02 Dec 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article