Development of a Scoring Algorithm To Replace Expert Rating for Scoring a Complex Performance-Based Assessment
Brian E. Clauser, Linette P. Ross, Stephen G. Clyman, Kathie M. Rose, Melissa J. Margolis, Ronald J. Nungester, Thomas E. Piemme, Lucy Chang, Gigi El-Bayoumi, Gary L. Malakoff, Pierre S. Pincetl
Applied Measurement in Education Volume 10, Number 4, ISSN 0895-7347
Describes an automated scoring algorithm for a computer-based simulation examination of physicians' patient-management skills. Results with 280 medical students show that scores produced using this algorithm are highly correlated to actual clinician ratings. Scores were also effective in discriminating between case performance judged passing or failing by independent clinicians. (SLD)
Clauser, B.E., Ross, L.P., Clyman, S.G., Rose, K.M., Margolis, M.J., Nungester, R.J., Piemme, T.E., Chang, L., El-Bayoumi, G., Malakoff, G.L. & Pincetl, P.S. (1997). Development of a Scoring Algorithm To Replace Expert Rating for Scoring a Complex Performance-Based Assessment. Applied Measurement in Education, 10(4), 345.