Simulations in evaluation of training: A medical example using standardised patients

Evaluation and Program Planning

Volumn 25, Issue 1, 2002, Pages 35-46

  Sanci, L A ^a,c   Day, N A ^b   Coffey, C M M ^a   Patton, G C ^a   Bowes, G ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b MONASH UNIVERSITY   (Australia)

^c ROYAL CHILDREN'S HOSPITAL   (Australia)

Author keywords

Adolescent health; Competency evaluation; Continuing medical education; Family physician; Randomised controlled trial; Standardised patient

Indexed keywords

EID: 3643127607     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0149-7189(01)00047-7     Document Type: Article

References (51)

1. Badger L.W., deGruy F., Hartman J., et al. Stability of standardized patients' performance in a study of clinical decision making. Family Medicine. 27:1995;126-131
2. Barrows H.S. An overview of the uses of standardized patients for teaching and evaluating clinical skills. Academic Medicine. 68:(6):1993;443-452
3. Colliver J.A. Validation of standardized-patient assessment: A meaning for clinical competence. Academic Medicine. 70:1995;1062-1064
4. Colliver J.A., Swartz M.H. Assessing clinical performance with standardized patients. JAMA. 278:1997;790-791
5. Colliver J.A., Morrison L.J., Markwell S.J., Verhulst S.J., Steward D.E., Dawson-Saunders E., Barrows H.S. Three studies of the effect of multiple standardized patients on intercase reliability of five standardized-patient examinations. Teaching and learning Medicine. 2:(4):1990;237-245
6. Colliver J.A., Robbs R.S., Vu N.V. Effects of using two or more standardized patients to simulate the same case on case means and case failure rates. Academic Medicine. 66:1991;616-618
7. Colliver J.A., Steward D.E., Markwell S.J., Marcy M. Effect of repeated simulations by standardized patients on intercase reliability. Teaching and learning Medicine. 3:(1):1991;15-19
8. Davis D., Lindsay E., Mazmanian P. The effectiveness of CME interventions. Davis D.A., Fox R.D. The physician as learner. Linking research to practice. 1994;241-278 American Medical Association, Chicago
9. Davis D.A., Thomson M.A., Oxman A.D., Haynes R.B. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 274:1995;700-705
10. Fox R., Davis D., Wentz D. The case for research on continuing medical education. Davis D.A., Fox R.D. The physician as learner. Linking research to practice. 1994;15-26 American Medical Association, Chicago
11. Gask L., Usherwood T., Thompson H., Williams B. Medical Education. 32:1998;190-198
12. Gonczi A., Hager P., Oliver L. Establishing competency-based standards in the professions. 1990;Australian Government Publishing Service, Canberra
13. Greene J.C., Caracelli V.J. Advances in mixed-method evaluation: The challenges and benefits of integrating diverse paradigms. 1997;Jossey-Bass, San Francisco
14. Kaaya S., Goldberg D., Gask L. Management of somatic presentations of psychiatric illness in general medical settings: Evaluation of a new training course for general practitioners. Medical Education. 26:1992;138-144
15. Kinnersley P., Pill R. Potential of using simulated patients to study the performance of general practitioners. British Journal of General Practice. 43:1993;297-300
16. Kirkpatrick D.L. Evaluating training: Evidence vs. proof. Training and Development Journal. 31:1977;9-14
17. Kopelow M. Competency-based assessment using standardized patients and other measures. Davis D.A., Fox R.D. The physician as learner. Linking research to practice. 1994;157-168 American Medical Association, Chicago
18. Mast T., Davis D. Concepts of competence. Davis D.A., Fox R.D. The physician as learner. Linking research to practice. 1994;139-156 American Medical Association, Chicago
19. Masters G.N., McCurry D. Competency-based assessment in the professions. 1990;Australian Government Publishing Service, Canberra
20. Miller G.E. Conference summary. Academic Medicine. 68:(6):1993;471-474
21. Mudge P.R., Bramley J. Vocational training and continuing medical education in general practice. 1990;The Royal Australian College of General Practitioners
22. Norman G.R. Objective measurement of clinical performance. Medical Education. 19:1985;43-47
23. Norman G.R., Tugwell P., Feightner J.W. A comparison of resident performance on real and simulated patients. Journal of Medical Education. 57:1982;708-715
24. Norman G.R., Neufeld V.R., Walsh A., Woodward C.A., McConvey G.A. Measuring physicians' performances by using simulated patients. Journal of Medical Education. 60:1985;925-934
25. O'Hagan J.J., Davies L.J., Pears R.K. The use of simulated patients in the assessment of actual clinical performance in general practice. New Zealand Medical Journal. 99:1986;948-951
26. Owen J.M., Rogers P.J. Program evaluation forms and approaches. 1999;Allen & Unwin, St Leonards, NSW
27. Petrusa E.R. The effect of number of cases on performance on a standardized multiple-station clinical examination. Journal of Medical Education. 62:1987;859-860
28. Pieters H.M., Touw-otten F.W.W.M., De Melker R.A. Simulated patients in assessing consultation skills of trainees in general practice vocational training: A validity study. Medical Education. 28:1994;226-233
29. Rethans J.J.E., van Boven C.P.A. Simulated patients in general practice: A different look at the consultation. Bristish Medical Journal. 294:1999;809-812
30. Rethans J.-J., Drop R., Sturmans F., van der Vleuten C. A method for introducing standardized (simulated) patients into general practice consultations. British Journal of General Practice. 41:1991;94-96
31. Rethans J.-J., Sturmans F., Drop R., van der Vleuten C. Assessment of the performance of general practitioners by the use of standardized (simulated) patients. British Journal of General Practice. 4:1991;97-99
32. Rethans J.-J., Sturmans F., Drop R., van der Vleuten C., Hobus P. Does competence of general practitioners predict their performance? Comparison between examination setting and actual practice. Bristish Medical Journal. 303:1991;1377-1380
33. Roberts J., Norman G. Reliability and learning from the objective structured clinical examination. Medical Education. 24:1990;219
34. Rosen D. The adolescent interview project. Johnson J. Adolescent medicine residency training resources. 1995;1-15 American Academy of Pediatrics, Elk Grove Village, IL
35. Sanazaro P.J. Determining physicians' performance: Continuing medical education and other interacting variables. Evaluation and the Health Professions. 6:1983;197-210
36. Sanci L.A., Coffey C.M.M., Veit F.C.M., Carr-Gregg M., Patton G.P., Day N., Bowes G. Evaluation of the effectiveness of an educational intervention for general practitioners in adolescent health care: Randomised controlled trial. BMJ. 320:2000;224-230
37. Sanders N.M. Evaluation of training by trainers. Brinkerhoff R.O., Smith N.L. Evaluating training programs in business and industry. 1989;59-71 Jossey-Bass, San Francisco
38. Swanson D.B., Norman G.R., Linn R.L. Performance-based assessment: Lessons from the health professions. Educational Researcher. 24:(5):1995;5-11
39. Tamblyn R.M., Klass D.J., Schanbl G.K., Kopelow M.L. Factors associated with the accuracy of standardized patient presentation. Academic Medicine. 65:1990;S55-S56
40. Tamblyn R.M., Klass D.J., Schanbl G.K., Kopelow M.L. Sources of unreliability and bias in standardized-patient rating. Teaching and learning Medicine. 3:(2):1991;74-85
41. Thomson A.N. Consumer assessment of interveiw skills in a family practice certification examination. Family Medicine. 25:1993;41-44
42. Van der Vleuten C.P.M., Swanson D.B. Assessment of clinical skills with standardized patients: State of the art. Teaching and learning Medicine. 2:(2):1990;58-76
43. Van der Vleuten C., Norman G.R., De Graaff E. Pitfalls in the pursuit of objectivity: Issues of reliability. Medical Education. 25:1991;110-118
44. Veit F.C.M., Sanci L.A., Young D.Y.L., Bowes G. Adolescent health care: Perspectives of Victorian general practitioners. Medical Journal of Australia. 163:1995;16-18
45. Veit F.C.M., Sanci L.A., Coffey C.M.M., Young D.Y.L., Bowes G. Barriers to effective primary health care for adolescents. Medical Journal of Australia. 165:1996;131-133
46. Vu N.V., Barrows H.S. Use of standardized patients in clinical assessments: Recent developments and measurement findings. Educational Researcher. 23:(3):1994;23-30
47. Vu N.V., Steward D.E., Marcy M. An assessment of the consistency and accuracy of standardized patients' simulations. Journal of Medical Education. 62:1987;1000-1002
48. Vu N.V., Marcy M.M., Colliver J.A., Verhulst S.J., Travis T.A., Barrows H.S. Standardized (simulated) patients' accuracy in recording clinical performance check-list items. Medical Education. 26:1992;99-104
49. Ward J. Continuing medication education. Part 1. Introduction to the series. Medical Journal of Australia. 148:1988;20-22
50. Ward J. Continuing medical education. Part 4. Evaluation of continuing medical education. Medical Journal of Australia. 148:1988;183-185
51. Williams R.G., Barrows H.S., Vu N.V., Verhulst S.J., Colliver J.A., Marcy M., Steward D. Direct, standardized assessment of clinical competence. Medical Education. 21:1987;482-489