A model for setting performance standards for standardized patient examinations

Evaluation and the Health Professions

Volumn 26, Issue 4, 2003, Pages 427-446

  Talente, Gregg ^a   Haist, Steven A ^b   Wilson, John F ^b  

^a EAST CAROLINA UNIVERSITY   (United States)

^b UNIVERSITY OF KENTUCKY   (United States)

Author keywords

Medical education; Standard setting; Standardized patients; Testing

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; EXAMINATION; HEALTH CARE QUALITY; HUMAN; HUMAN EXPERIMENT; JOB PERFORMANCE; MEDICAL EDUCATION; MODEL; MODIFIED ANGOFF STANDARD SETTING PROCEDURE; NORMAL HUMAN; PATIENT CARE; PHYSICAL EXAMINATION; RATING SCALE; REFERENCE VALUE; STANDARD; STANDARDIZATION; VARIANCE;

CLINICAL COMPETENCE; EDUCATIONAL MEASUREMENT; EVALUATION STUDIES; HEALTH SERVICES RESEARCH; HUMANS; INTERNSHIP AND RESIDENCY; PATIENT SIMULATION; PHYSICAL EXAMINATION; PROCESS ASSESSMENT (HEALTH CARE); REFERENCE STANDARDS; TASK PERFORMANCE AND ANALYSIS; UNITED STATES;

EID: 0242389820     PISSN: 01632787     EISSN: None     Source Type: Journal    
DOI: 10.1177/0163278703258105     Document Type: Article

References (14)

1. Angoff, W. (1971). Scales, norms and equivalent scores. In R. Thorndike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
2. American Board of Medicine. (1998). Attending physicians: Your role in evaluating residents. Philadelphia: American Board of Internal Medicine.
3. Berk, R. A. (1996). Standard setting: The next generation. Applied Measurement In Education, 9, 215-236.
4. Cusimano, M. D. (1996). Standard setting in medical education. Academic Medicine, 71, s112-s120.
5. Friedman Ben-David, M. (2000). AMEE guide no. 18: Standard setting in student assessment. Medical Teacher, 22. 120-130.
6. Hambleton, R., & Plake, B. (1995). Using an extended Angoff procedure to set standards on complex performance assessments. Applied Measurement In Education, 8, 41-55.
7. Hurtz, G., & Hertz, N. (1999). How many raters should be used for establishing cutoff scores with the Angoff method? A generalizability theory study. Educational and Psychological Measurement, 59, 885-897.
8. Impara, J., & Plake, B. (1997). Standard setting: An alternative approach. Journal of Educational Measurement, 34, 353-366.
9. Impara, J., & Plake, B. (1998). Teacher's ability to estimate item difficulty: A test of the assumptions in the Angoff standard setting method. Journal of Educational Measurement, 35, 69-81.
10. Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational measurement (pp. 485-515). New York: MacMillan.
11. Mills, C. N. (1995). Comments on methods of setting standards for complex performance tests. Applied Measurement in Education, 8, 93-97.
12. Noel, G. L., Herbers, J. E., Caplow, M. P., Cooper, G. S., Pangaro, L. N., & Harvey, J. (1992). How well do internal medicine faculty members evaluate clinical skills of residents? Annals of Internal Medicine, 117(9), 757-765.
13. Norcini, J. J. (1993). Scoring and standard setting with standardized patients. Evaluation and the Health Professions, 16, 322-332.
14. Norcini, J. J., & Shea, J. A. (1997). The credibility and comparability of standards. Applied Measurement in Education, 10, 39-59.