A comparison of two approaches for modeling expert judgment in scoring a performance assessment of physicians' patient-management skills

Academic Medicine

Volumn 73, Issue 10 SUPPL., 1998, Pages

  Clauser, Brian E ^a   Ross, Linette P ^b   Fan, Van Y ^b   Clyman, Stephen G ^b  

^a NATIONAL BOARD OF MEDICAL EXAMINERS   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; CLINICAL PRACTICE; COMPUTER; CONFERENCE PAPER; DOCTOR PATIENT RELATION; FOLLOW UP; HUMAN; HUMAN EXPERIMENT; INTERMETHOD COMPARISON; LICENSING; MEDICAL DECISION MAKING; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; RATING SCALE; REGRESSION ANALYSIS; RELIABILITY; STATISTICAL ANALYSIS;

EID: 0031717234     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/00001888-199810000-00065     Document Type: Conference Paper

References (10)

1. Pearson K. On the problem of sexing osteometric material. Biometrika. 1915,10:479-87.
2. Thorndike EL. Fundamental theorems in judging men. J Appl Psychol. 1918;2:67-76.
3. Meehl PE. Clinical versus Statistical Prediction: A Theoretical Analysis and Review of the Evidence. Minneapolis, MN: University of Minnesota Press, 1954.
4. Dawes RM, Corrigan B. Linear models in decision making. Psychol Bull. 1974;81:95-106.
5. Page EB, Petersen NS. The computer moves into essay grading. Phi Delta Kappan. 1995;76:561-5.
6. Bejar II. A methodology for scoring open-ended architectural design problems. J Appl Psychol. 1991;76:522-32.
7. Clauser BE, Margolis MJ, Clyman SG, Ross LP. Development of automated scoring algorithms for complex performance assessments: a comparison of two approaches. J Educ Meas. 1997;34:141-61.
8. Clauser BE, Swanson DB, Clyman SG. The generalizability of scores from a performance assessment of physicians' patient management skills. Acad Med. 1996;71(10 Suppl):S109-S111.
9. Ross LP, Clauser BE, Fan V, Clyman SG. An evaluation of alternative models for automated scoring of a computer delivered performance assessment. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA, April 1998.
10. Ross LP, Clauser BE, Clyman SG. The validity of expert judgment for scoring performance assessments: are all judges evaluating the same trait? Proceedings of the Eighth Annual Ottawa Conference. Philadelphia, PA: National Board of Medical Examiners, in press.