Using the Angoff method to set defensible cutoff scores for standardized patient performance evaluations in PA education

Journal of Physician Assistant Education

Volumn 20, Issue 1, 2009, Pages 15-23

  Carlson, Jim ^a   Tomkowiak, John ^b   Stilp, Curt ^c  

^a ROSALIND FRANKLIN UNIVERSITY OF MEDICINE AND SCIENCE   (United States)

^b ROSALIND FRANKLIN UNIVERSITY OF MEDICINE AND SCIENCE   (United States)

^c OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 74349110142     PISSN: 19419430     EISSN: None     Source Type: Journal    
DOI: 10.1097/01367895-200920010-00003     Document Type: Article

References (23)

1. Calhoun B, Vrbin C, Grzybicki D. The use of standardized patients in the training and evaluation of physican assistant students. J Physician Assist Educ. 2008;19(1):18-23.
2. Calhoun B, Chambers D. Standardized patients and simulated patient encounters in the evaluation of students. Perspective on Physician Assistant Education. 2004;15(2):99-101.
3. Barrows HS. Simulated Patients (Programmed Patients): The Development and Use of a New Technique in Medical Education. Springfield, IL: Charles C Thomas; 1971.
4. Epstein RM. Assessment in medical education. N Engl J Med. 2007;356: 387-396.
5. Anderson K, Johnston A, Knudson J, Tournell C. The Use of Case-Specific Checklists in Evaluating Physician Assistant Student Performance During Standardized Patient Encounters. [Master's Thesis]. Rosalind Franklin University of Medicine and Science; May 2006.
6. Williams R. Have standardized patient examinations stood the test of time and experience? Teach Learn Med. 2004;16(2):215-222.
7. Barman A. Critiques on the objective structured clinical examination. Annals Academy of Medicine Singapore. 2005;(34):478-82.
8. Huber P, Baroffio A, Chamot E, Herrmann F, Nendaz MR, Vu NV. Effects of item and rater characteristics on checklist recording: what should we look for? Med Educ. 2005; 39(8):852-8.
9. Vu NV, Marcy MM, Colliver JA, Verhulst SJ, Travis TA & Barrows HS. Standardized (simulated) patients' accuracy in recording clinical performance check-list items. Med Educ. 1992;26(2):99-104.
10. Downing S, Tekian A, Yudkowski R. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med. 2005;18(1):50-57.
11. Resse A, Chung E, Gardiner M, Williams S. Competency domains in an undergraduate objective structured clinical examination: their impact on compensatory standard setting. Med Educ. 2008;42:600-606.
12. Noricini J. Setting standards on educational tests. Med Educ. 2003;37: 464-469.
13. Boulet JR, De Champlain AF, McKinley DW. Setting defensible performance standards on OSCEs and standardized patient examinaions. Medical Teacher. 2003;25(3): 245-9.
14. Verhoeven B, Van der Steeg A, Scherpbier A, Muijtjens A, Verwijnen G, van der Vleuten C. Reliability and credibility of an Angoff standard setting procedure in progress testing using recent graduates as judges. Med Educ. 1999;33: 832-837.
15. Kaufman D, Mann K, Muijitjens A, van der Vleuten C. A comparison of standard-setting procedures for an OSCE in undergraduate medical education. Acad Med. 2000;75(3): 267-71.
16. Kramer A, Muijtjens A, Jansen K, Dusman H, Tan L, Vleuten C. Comparison of a rational and empirical standard setting procedure for an OSCE. Med Educ. 2003;37: 132-139.
17. Ricker K. Setting Cut Scores: Critical Review of Angoff and Modified-Angoff Methods. Center for Applied Measurement and Evaluation. University of Alberta, Canada. http://www.education.ualberta.ca/educ/psych/crame/files/RickerCSSE2003.pdf. Accessed March 1, 2008.
18. Gorter S, Rethans JJ, Scherpbier A, van der Heijde D, Houben H, van der Vleuten C, van der Linden S. Developing case-specific checklists for standardized patient-based assessments in internal medicine: a review of the literature. Acad Med. 2000;75:1130-7.
19. Schirmer J, Mauksch L, Lang F, Marvel K, Aoppi K, Epstein R, Brock D, Pryzbylski M. Assessing communication competence: a review of current tools. Fam Med. 2005;37(3):184-92.
20. Sanju G, Haque M & Oyebode F. Standard setting: comparison of two methods. BMC Med Educ. 2006;6:46.
21. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-74.
22. Downing SM. Validity on the meaningful interpretation of assessment data. Med Educ. 2003;37:830-837.
23. Asprey D, Hegmann T, Bergus G. Comparison of medical student and physician assistant student performance on standardized-patient assessments. J Physician Assist Educ. 2007;18 (4):16-19.