Predicting Mastery Level on a Large-scale Standardized Patient Test: A Comparison of Case and Instrument Score-based Models Using Discriminant Function Analysis

Advances in Health Sciences Education

Volumn 6, Issue 2, 2001, Pages 151-158

  De Champlain, André F ^a   Margolis, Melissa J ^a   Macmillan, Mary K ^a   Klass, Daniel J ^a  

^a NATIONAL BOARD OF MEDICAL EXAMINERS   (United States)

Author keywords

Multivariate analysis; OSCE; Psychometrics; Standard setting; Standardized patients

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; COMPARATIVE STUDY; DISCRIMINANT ANALYSIS; EDUCATION; EDUCATIONAL MODEL; HUMAN; METHODOLOGY; MULTIVARIATE ANALYSIS; PSYCHOMETRY; STANDARD; UNITED STATES;

CLINICAL COMPETENCE; DISCRIMINANT ANALYSIS; EDUCATIONAL MEASUREMENT; HUMANS; MODELS, EDUCATIONAL; MULTIVARIATE ANALYSIS; PSYCHOMETRICS; UNITED STATES;

EID: 0035223971     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1011421706300     Document Type: Article

References (11)

1. Baxter, G.P., Shavelson, R.J., Goldman, S.R. & Pine, J. (1992). Evaluation of procedure-based scoring for hands-on science assessment. Journal of Educational Measurement 29: 1-17.
2. Bejar, I.I. (1991). A methodology for scoring open-ended architectural design problems. Journal of Applied Psychology 76: 522-532.
3. Bennett, R.E. & Sebrechts, M.M. (1996). The accuracy of expert-system diagnoses of mathematical problem solutions. Applied Measurement in Education 9: 133-150.
4. Clauser, B.E., Subhiyah, R.G., Nungester, R.J., Ripkey, D.R., Clyman, S.G. & McKinley, D. (1995). Scoring a performance-based assessment by modeling the judgments of experts. Journal of Educational Measurement 32: 397-415.
5. Clauser, B.E., Margolis, M.J., Clyman, S.G. & Ross, L.P. (1997). Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches. Journal of Educational Measurement 34: 141-161.
6. Hardy, R.A. (1995). Examining the costs of performance assessment. Applied Measurement in Education 8: 121-134.
7. Huberty, C.J. & Barton, R.M. (1989). An introduction to discriminant analysis. Measurement and Evaluation in Counseling and Development 22: 158-168.
8. Margolis, M.J., De Champlain, A.F. & Klass, D.J. (1998). Comparing Alternative Procedures for Scoring a Performance-Based Assessment of Physicians' Clinical Skills. Paper presented at the meeting of the National Council on Measurement in Education, San Diego, CA. April.
9. Margolis, M.J., De Champlain, A.F. & Klass, D.J. (1998). Setting examination-level standards for a performance-based assessment of physicians' clinical skills. Academic Medicine 73(10 suppl): S114-S116.
10. Norcini, J.J., Diserens, D., Day, S.C., Cebul, R.D., Schwartz, J.S., Beck, L.H., Webster, G.D., Schnabel, T.G. & Elstein, A. (1990). The scoring and reproducibility of an essay test of clinical judgment. Academic Medicine 65(9 suppl): S41-S42.
11. Thompson, B. (1998). Five Methodology Errors in Educational Research: The Pantheon of Statistical Significance and other Faux Pas. Paper presented at the meeting of the American Educational Research Association, San Diego, CA. April.