Do discrepancies in standardized patients' checklist recording affect case and examination mastery-level decisions?

Academic Medicine

Volumn 73, Issue 10 SUPPL., 1998, Pages

  De Champlain, André F ^a   Macmillan, Mary K ^b   Margolis, Melissa J ^b   King, Ann M ^b   Klass, Daniel J ^b  

^a NATIONAL BOARD OF MEDICAL EXAMINERS   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; COHORT ANALYSIS; CONFERENCE PAPER; DOCTOR PATIENT RELATION; HUMAN; HUMAN EXPERIMENT; LICENSING; MEDICAL DECISION MAKING; NORMAL HUMAN; PATIENT CARE; PRIORITY JOURNAL; RATING SCALE; STANDARDIZATION;

EID: 0031692716     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (17)

1. Anderson MB, Stillman PL, Wang Y. Growing use of standardized patients in teaching and evaluation in medical education. Teach Learn Med. 1994;6:15-22.
2. Barrows HS. Simulated (Standardized) Patients and Other Human Simulations: A Comprehensive Guide to Their Training and Use in Teaching and Evaluation. Chapel Hill, NC: Health Sciences Consortium, 1987.
3. Swanson DB, Norcini JJ. Factors influencing reproducibility of tests using standardized patients. Teach Learn Med. 1989;19:158-66.
4. Swanson DB, Norman GR, Linn RL. Performance-based assessment: lessons from the health professions. Educational Researcher. 1995;24:5-11.
5. Vu NV, Barrows HS. Use of standardized patients in clinical assessments: recent developments and measurement findings. Educational Researcher. 1994;23:23-30.
6. De Champlain AF, Margolis MJ, King A, Klass DJ. Standardized patients' accuracy in recording examinees' behaviors using checklists. Acad Med. 1997;72:S85-S87.
7. Vu NV, Marcy JA, Colliver SJ, Verhulst SJ, Travis TA, Barrows HS. Standardized (simulated) patients' accuracy in recording clinical performance checklist items. Med Educ. 1992;26:99-104.
8. Van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardized patients: state of the art. Teach Learn Med. 1990; 2:58-76.
9. Linn RL, Burton E. Performance-based assessment: implications of task specificity. Educational Measurement: Issues and Practice. 1994;13:5-15.
10. Colliver JA, Morrison LJ, Markwell SJ, et al. Three studies of the effect of multiple standardized patients on intercase reliability of five standardized-patient examinations. Teach Learn Med. 1990;2:237-45.
11. Colliver JA, Marcy ML, Vu NV, Steward DE, Robbs RS. Effect of using multiple standardized patients to rate interpersonal and communication skills on intercase reliability. Teach Learn Med. 1994;6:45-8.
12. Reznick R, Smee S, Rothman R, et al. An objective structured clinical examination for the licentiate: Report of the pilot project of the Medical Council of Canada. Acad Med. 1992;67:487-94.
13. Colliver JA, Robbs RS, Vu NV. Effects of using two or more standardized patients to simulate the same case on case means and case failure rates. Acad Med. 1991;66:616-8.
14. Tamblyn RM, Klass DJ, Schnabl GK, Kopelow ML. Sources of unreliability and bias in standardized patient rating. Teach Learn Med. 1991;3:74-85.
15. Margolis MJ, Clauser BE, Ross LP, De Champlain AF, Klass DJ, Nungester RJ. Exploring alternative methods for scoring a performance assessment of physicians' clinical skills. Paper presented at the Research in Medical Education meeting, Washington, DC, 1997.
16. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960;20:37-46.
17. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-73.