Have standardized patient examinations stood the test of time and experience?

Teaching and Learning in Medicine

Volumn 16, Issue 2, 2004, Pages 215-222

  Williams, Reed G ^a  

^a SOUTHERN ILLINOIS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ALGORITHM; ANAMNESIS; COMPETENCE; ERROR; EXPERIENCE; HEALTH CARE QUALITY; HUMAN; LEARNING; MEASUREMENT; MEDICAL DECISION MAKING; MEDICAL EDUCATION; MEDICAL EXAMINATION; MEDICAL RECORD; MEDICAL SCHOOL; METHODOLOGY; PATIENT CARE; PERFORMANCE; PHYSICAL EXAMINATION; PREDICTION; RELIABILITY; RESIDENCY EDUCATION; REVIEW; RISK ASSESSMENT; SCORING SYSTEM; SCREENING; SIMULATION; STANDARDIZATION; TEACHING; TRAINING; VALIDATION PROCESS;

EID: 3042735125     PISSN: 10401334     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15328015tlm1602_16     Document Type: Review

References (51)

1. Colliver JA, Williams RG. Technical issues: Test application. AAMC. Academic Medicine 1993;68:454-63.
2. Luck J, Peabody JW. Using standardised patients to measure physicians' practice: Validation study using audio recordings. British Medical Journal 2002;325:679.
3. Russell NK, Boekeloo BO, Rafi IZ, Rabin DL. Using unannounced simulated patients to evaluate sexual risk assessment and risk reduction skills of practicing physicians. Academic Medicine 1991;66:S37-9.
4. Tamblyn RM, Klass DK, Schnabl GK, Kopelow ML. Factors associated with the accuracy of standardized patient presentation. Academic Medicine 1990;65:S55-6.
5. Peitzman SJ. Physical diagnosis findings among persons applying to work as standardized patients. Academic Medicine 2001;76:383.
6. Tamblyn R, Klass D, Schnabl G, Kopelow M. Sources of unreliability and bias in standardized-patient rating. Teaching and Learning in Medicine 1991;3:74-85.
7. De Champlain AF, Margolis MJ, King A, Klass DJ. Standardized patients' accuracy in recording examinees' behaviors using checklists. Academic Medicine 1997;72:S85-7.
8. Vu NV, Marcy MM, Colliver JA, Verhulst SJ, Travis TA, Barrows HS. Standardized (simulated) patients' accuracy in recording clinical performance check-list items. Medical Education 1992;26:99-104.
9. Pangaro LN, Worth-Dickstein H, Macmillan MK, Klass DJ, Shatzer JH. Performance of "standardized examinees" in a standardized-patient examination of clinical skills. Academic Medicine 1997;72:1008-11.
10. Williams RG, McLaughlin MA, Eulenberg B, Hurm M, Nendaz MR. The Patient Findings Questionnaire: One solution to an important standardized patient examination problem. Academic Medicine 1999;74:1118-24.
11. Roter DL, Hall JA. Physician's interviewing styles and medical information obtained from patients. Journal of General Internal Medicine 1987;2:325-9.
12. Billings J, Stoeckle J. The clinical encounter: A guide to the medical interview and case presentation. Saint Louis MO: Mosby, 1999.
13. Coulehan J, Block M. The medical interview: A primer for students of the art. Philadelphia: Davis, 1992.
14. Kane MT. The assessment of professional competence. Evaluation and the Health Professional 1992;15:163-82.
15. van der Vleuten D, Swanson D. Assessment of clinical skills with standardized patients: State of the art. Teaching and Learning in Medicine 1990;2:58-76.
16. Brennan R. Elements of generalizability theory. Iowa City: ACT Publications, 1983.
17. De Champlain AF, Klass DJ. Assessing the factor structure of a nationally administered standardized patient examination. Academic Medicine 1997;72:S88-90.
18. Page G, Bordage G. The Medical Council of Canada's key features project: A more valid written examination of clinical decision-making skills. Academic Medicine 1995;70:104-10.
19. Shatzer JH, Darosa D, Colliver JA, Barkmeier L. Station-length requirements for reliable performance-based examination scores. Academic Medicine 1993;68:224-9.
20. Shatzer J, Wardrop J, Williams R, Hatch T. The generalizability of performance on different station length standardized patient cases. Teaching and Learning in Medicine 1994;6:54-8.
21. Colliver JA, Mast TA, Vu NV, Barrows HS. Sequential testing with a performance-based examination using standardized patients. Academic Medicine 1991;66:S64-6.
22. Colliver JA, Vu NV, Barrows HS. Screening test length for sequential testing with a standardized-patient examination: A receiver operating characteristic (ROC) analysis. Academic Medicine 1992;67:592-5.
23. De Champlain AF, Clauser BE, Margolis MJ, Klass DJ, Nungester RJ. Assessing decision consistency with a sequentially administered large-scale standardized patient examination: A Monte Carlo investigation. Academic Medicine 1998;73:S78-80.
24. Gorter S, Rethans JJ, Scherpbier A, et al. Developing case-specific checklists for standardized-patient-based assessments in internal medicine: A review of the literature. Academic Medicine 2000;75:1130-7.
25. Swartz MH, Colliver JA, Bardes CL, Charon R, Fried ED, Moroff S. Validating the standardized-patient assessment administered to medical students in the New York City consortium. Academic Medicine 1997;72:619-26.
26. MacRae HM, Vu NV, Graham B, Word-Sims M, Colliver JA, Robbs RS. Comparing checklists and databases with physicians' ratings as measures of students' history and physical-examination skills. Academic Medicine 1995;70:313-7.
27. Travis TA, Colliver JA, Robbs RS, et al. Validity of simple approach to scoring and standard setting for standardized-patient cases in an examination of clinical competence. Academic Medicine 1996;71:S84-6.
28. Clauser BE, Clyman SG, Margolis MJ, Ross LP. Are fully compensatory models appropriate for setting standards on performance assessments of clinical skills? Academic Medicine 1996;71:890-2.
29. Clauser BE, Ross LP, Fan VY, Clyman SG. A comparison of two approaches for modeling expert judgment in scoring a performance assessment of physicians' patient-management skills. Academic Medicine 1998;73:S117-9.
30. Colliver JA, Barnhart AJ, Marcy ML, Verhulst SJ. Using a receiver operating characteristic (ROC) analysis to set passing standards for a standardized-patient examination of clinical competence. Academic Medicine 1994;69:S37-9.
31. Kopelow ML, Schnabl GK, Hassard TH, et al. Assessing practicing physicians in two settings using standardized patients. Academic Medicine 1992;67:S19-21.
32. Carney PA, Dietrich AJ, Freeman DH, Mott LA. A standardized-patient assessment of a continuing medical education program to improve physicians' cancer-control clinical skills. Academic Medicine 1995;70:52-8.
33. Russell NK, Boekeloo BO, Rafi IZ, Rabin DL. Unannounced simulated patients' observations of physician STD/HIV prevention practices. American Journal of Preventative Medicine 1992;8:235-40.
34. Smith SR. Correlations between graduates' performances as first-year residents and their performances as medical students. Academic Medicine 1993;68:633-4.
35. Vu NV, Barrows HS, Marcy ML, Verhulst SJ, Colliver JA, Travis T. Six years of comprehensive, clinical, performance-based assessment using standardized patients at the Southern Illinois University School of Medicine. Academic Medicine 1992;67:42-50.
36. Rutala PJ, Fulginiti JV, McGeagh AM, Leko EO, Koff NA, Witzke DB. Predictive validity of a required multidisciplinary standardized-patient examination. Academic Medicine 1992;67:S60-2.
37. Colliver JA, Swartz MH, Robbs RS, Lofquist M, Cohen D, Verhulst SJ. The effect of using multiple standardized patients on the inter-case reliability of a large-scale standardized-patient examination administered over an extended testing period. Academic Medicine 1998;73:S81-3.
38. Colliver JA, Robbs RS, Vu NV. Effects of using two or more standardized patients to simulate the same case on case means and case failure rates. Academic Medicine 1991;66:616-8.
39. De Champlain AF, MacMillan MK, King AM, Klass DJ, Margolis MJ. Assessing the impacts of intra-site and inter-site checklist recording discrepancies on the reliability of scores obtained in a nationally administered standardized patient examination. Academic Medicine 1999;74:S52-4.
40. De Champlain AF, Macmillan MK, Margolis MJ, King AM, Klass DJ. Do discrepancies in standardized patients' checklist recording affect case and examination mastery-level decisions? Academic Medicine 1998;73:S75-7.
41. Swartz MH, Colliver JA, Robbs RS, Cohen DS. Effect of multiple standardized patients on case and examination means and passing rates. Academic Medicine 1999;74:S131-4.
42. Williams RG, Lloyd JS, Simonton DK. Sources of OSCE examination information and perceived helpfulness: A Study of the grapevine. In IR Hart, RM Harden, J DesMarchais (Eds.), Current Developments in Assessing Clinical Competence (pp. 363-70). Montreal: Can-Heal Publications, 1992, 1990.
43. Colliver JA, Barrows HS, Vu NV, Verhulst SJ, Mast TA, Travis TA. Test security in examinations that use standardized-patient cases at one medical school. Academic Medicine 1991;66:279-82.
44. Colliver JA, Travis TA, Robbs RS, Barnhart AJ, Shirar LE, Vu NV. Test security in standardized-patient examinations: Analysis with scores on working diagnosis and final diagnosis. Academic Medicine 1992;67:S7-9.
45. Stillman PL, Haley HL, Sutnick AI, et al. Is test security an issue in a multistation clinical assessment? A preliminary study. Academic Medicine 1991;66:S25-7.
46. De Champlain AF, MacMillan MK, Margolis MJ, et al. Modeling the effects of security breaches on students' performances on a large-scale standardized patient examination. Academic Medicine 1999;74:S49-51.
47. De Champlain AF, Macmillan MK, Margolis MJ, Klass DJ, Lewis E, Ahearn S. Modeling the effects of a test security breach on a large-scale standardized patient examination with a sample of international medical graduates. Academic Medicine 2000;75:S109-11.
48. Swartz MH, Colliver JA, Cohen DS, Barrows HS. The effect of deliberate, excessive violations of test security on performance on a standardized-patient examination. Academic Medicine 1993;68:S76-8.
49. Cohen R, Rothman AI, Ross J, Poldre P. Impact of repeated use of objective structured clinical examination stations. Academic Medicine 1993;68:S73-5.
50. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teaching and Learning in Medicine 2003;15:270-92.
51. Whitcomb ME. Competency-based graduate medical education? Of course! But how should competency be assessed? Academic Medicine 2002;77:359-60.