Item response theory analysis of the mechanics baseline test
Author(s)
Cardamone, Carolin; Abbott, Jonathan E.; Rayyan, Saif; Seaton, Daniel; Pawl, Andrew; Pritchard, David E.; ... Show more Show less
Downloadpritch item response.pdf (188.5Kb)
OPEN_ACCESS_POLICY
Open Access Policy
Creative Commons Attribution-Noncommercial-Share Alike
Terms of use
Metadata
Show full item recordAbstract
Item response theory is useful in both the development and evaluation of assessments and in computing standardized measures of student performance. In item response theory, individual parameters (difficulty, discrimination) for each item or question are fit by item response models. These parameters provide a means for evaluating a test and offer a better measure of student skill than a raw test score, because each skill calculation considers not only the number of questions answered correctly, but the individual properties of all questions answered. Here, we present the results from an analysis of the Mechanics Baseline Test given at MIT during 2005-2010. Using the item parameters, we identify questions on the Mechanics Baseline Test that are not effective in discriminating between MIT students of different abilities. We show that a limited subset of the highest quality questions on the Mechanics Baseline Test returns accurate measures of student skill. We compare student skills as determined by item response theory to the more traditional measurement of the raw score and show that a comparable measure of learning gain can be computed.
Date issued
2011-08Department
Massachusetts Institute of Technology. Department of Mechanical Engineering; Massachusetts Institute of Technology. Department of Physics; Massachusetts Institute of Technology. Office of Digital LearningJournal
Proceedings of the Physics Education Research Conference, 2011
Publisher
American Institute of Physics
Citation
Cardamone, Caroline N. et al. “Item Response Theory Analysis of the Mechanics Baseline Test.” 2011 Physics Education Research Conference : Omaha, Nebraska, USA : 3-4 August 2011" editors, N. Sanjay Rebello, Paula V. Engelhardt, Chandralekha Singh., American Institute of Physics, Melville, N.Y.2012. (AIP Conf. Proc. p. 135–138). CrossRef. Web.
Version: Author's final manuscript
ISBN
978-0-7354-0990-3
ISSN
1539-9028
0094-243X