Workplace-based assessment as an educational tool: AMEE Guide No. 31

Medical Teacher

Volumn 29, Issue 9-10, 2007, Pages 855-871

  Norcini, John ^a   Burch, Vanessa ^b  

^a FOUNDATION FOR ADVANCEMENT OF INTERNATIONAL MEDICAL EDUCATION AND RESEARCH   (United States)

^b UNIVERSITY OF CAPE TOWN   (South Africa)

Author keywords

[No Author keywords available]

Indexed keywords

ANAMNESIS; CLINICAL COMPETENCE; CLINICAL PRACTICE; CURRICULUM; FACULTY PRACTICE; FACULTY STUDENT RELATION; HUMAN; LEARNING ENVIRONMENT; MEDICAL EDUCATION; MEDICAL SCHOOL; PATIENT ASSESSMENT; PEER REVIEW; POSTGRADUATE EDUCATION; QUALITY CONTROL; REVIEW; STUDENT ATTITUDE; WORKPLACE;

CLINICAL CLERKSHIP; CLINICAL COMPETENCE; COMPETENCY-BASED EDUCATION; EDUCATIONAL MEASUREMENT; FACULTY; FEEDBACK, PSYCHOLOGICAL; HUMANS; INTERNSHIP AND RESIDENCY; PSYCHOLOGY, EDUCATIONAL; STAFF DEVELOPMENT; STUDENTS, MEDICAL; TEACHING;

EID: 37849037053     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.1080/01421590701775453     Document Type: Review

References (77)

1. Arnold, L., Willoughby, L., Calkins, V. and Eberhart, G. (1981) Use of peer evaluation in the assessment of medical students. Med Educ, 56, pp. 35-41.
2. Archer, JC, Norcini, JJ and Davies, HA (2005) Peer review of paediatricians in training using SPRAT. Br Med J, 330, pp. 1251-1253.
3. Association Of American Medical Colleges (2004) Medical school graduation questionnaire: All schools report.
4. Balzer, WK, Doherty, ME and O'connor Jr, R. (1989) Effects of cognitive feedback on performance. Psychol Bull, 106, pp. 410-433.
5. Bargh, JA, Gollwitzer, PM, Lee-Chai, A., Barndollar, K. and Trotshcel, R. (2001) The automated will: Nonconscious activation and pursuit of behavioural goals. J Personality Social Psychol, 81, pp. 1014-1027.
6. Beck, RS, Daughtridge, R. and Sloane, PD (2002) Physician-patient communication in the primary care office: A systematic review. J Ame Board Fam Pract, 15, pp. 25-38.
7. Boulet, JR, Mckinley, DW, Norcini, JJ and Whelan, GP (2002) Assessing the comparability of standardized patient and physician evaluations of clinical skills. Ad Health Sci Educ, 7, pp. 85-97.
8. Branch, WT and Paranjape, A. (2002) Feedback and reflection: Teaching methods for clinical settings. Acad Med, 77, pp. 1185-1188.
9. Burch, VC, Seggie, JL and Gary, NE (2006) Formative assessment promotes learning in undergraduate clinical clerkships. S Af Med, 96, pp. 430-433.
10. Butler, DL and Winnie, PH (1995) Feedback and elf-regulated learning: A theoretical synthesis. Rev Educ Res, 65, pp. 245-274.
11. Craven, RG, Marsh, HW and Debus, RL (1991) Effects of internally focused feedback and attributional feedback on enhancement of academic self-concept. J Educ Psychol, 83, pp. 17-27.
12. Crooks, TJ (1988) The impact of classroom evaluation practices on students. Rev Educ Res, 58, pp. 438-481.
13. Daelmans, HE, Overmeer, RM and van der Hem-Stokroos, HH (2005) Reliability of the clinical teaching effectiveness instrument. Med Educ, 39, pp. 904-910.
14. Day, SC, Grosso, LG, Norcini, JJ, Blank, LL, Swanson, DB and Horne, MH (1990) Residents' perceptions of evaluation procedures used by their training program. J Gen Inter Med, 5, pp. 421-426.
15. Daelmans, HE, Hoogenboom, RJ, Donker, AJ, Scherpbier, AJ, Stehouwer, CD and Van Der Vleuten, CP (2004) Effectiveness of clinical rotations as a learning environment for achieving competences. Med Teach, 26, pp. 305-312.
16. Driessen, E. and Van Der Vleuten, C. (2000) Matching student assessment to problem-based learning: Lessons from experience in a law faculty. Stud Cont Educ, 22, pp. 235-248.
17. Durning, SJ, Cation, LJ, Markert, RJ and Pangaro, LN (2002) Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Acad Med, 77, pp. 900-904.
18. Ende, J. (1983) Feedback in medical education. J Am Med Assoc, 250, pp. 777-781.
19. Finlay, K., Norman, GR, Stolberg, H., Weaver, B. and Keane, DR (2006) In-training evaluation using hand-held computerized clinical work sampling strategies in radiology residency. J Can Ass Radiol, 57, pp. 232-237.
20. Frederiksen, N. (1984) The real test bias. Influences on testing and teaching and learning. Am Psychol, 39, pp. 193-202.
21. Gibbs, G. (1999) Using assessment strategically to change the way students learn. Assessment Matters in Higher Education. Choosing and using Diverse Approaches, Society for Research into Higher Education and Open University Press, Buckingham
22. Gibbs, G. and Simpson, C. (2004) Conditions under which assessment supports student learning. Learn Teach Higher Educ, 1, pp. 3-31.
23. Gipps, C. (1999) Socio-cultural aspect of assessment. Rev Educ Res, 24, pp. 355-392.
24. Gronlund, NE (1998) Assessment of Student Achievement, Allyn and Bacon, Needham Heights, MA
25. Hampton, JR, Harrison, MJG, Mitchell, JRA, Prichard, JS and Seymour, C. (1975) Relative contributions of history-taking, physical examination, and laboratory investigation to diagnosis and management of medical outpatients. Br Med J, 2, pp. 486-489.
26. Harackiewicz, JM (1979) The effect of reward contingency and performance feedback on intrinsic motivation. J Pers Soc Psychol, 37, pp. 1352-1363.
27. Hatala, R., Ainslie, M., Kassen, BO, Mackie, I. and Roberts, JM (2006) Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination. Med Educ, 40, pp. 950-956.
28. Hatala, R. and Norman, GR (1999) In-training evaluation during an Internal Medicine clerkship. Acad Med, 74, pp. S118-S120.
29. Hattie, JA (1999) Influences on Student Learning, Inaugural professorial address, University of Auckland, New Zealand
30. Hattie, J. and Timperley, H. (2007) The power of feedback. Rev Educl Res, 77, pp. 81-112.
31. Hauer, KE (2000) Enhancing feedback to students using the mini-CEX (clinical evalaution exercie). Acad Med, 75, p. 524.
32. Herbers, JE, Noel, GL, Cooper, GS, Harvey, J., Pangaro, LN and Weaver, MJ (1992) How accurate are faculty evaluations of clinical competence?. J Gen Inter Med, 4, pp. 202-208.
33. Hewson, MG and Little, ML (1998) Giving feedback in medical education. Verification of recommened techniques. J Gen Inter Med, 13, pp. 111-116.
34. Holmboe, ES, Yepes, M., Williams, F. and Huot, SJ (2004) Feedback and the mini-clinical evaluation exercise. J Gen Inter Med, 19, pp. 558-561.
35. Holmboe, ES, Hawkins, RE and Huot, SJ (2004) Direct observation of competence training: A randomized controlled trial. Ann Inter Med, 140, pp. 874-881.
36. Holmboe, ES, Fiebach, NH, Galaty, LA and Huot, S. (2001) Effectiveness of a focused educational intervention on resident evaluations from faculty: A randomized controlled trial. J Gen Intern Med, 16, pp. 427-434.
37. Holmboe, ES, Huot, S., Chung, J., Norcini, JJ and Hawkins, RE (2003) Construct validity of the miniClinical Evaluation Exercise (MiniCEX). Acad Med, 78, pp. 826-830.
38. Isaacson, JH, Posk, LK, Litaker, DG and Halperin, AK (1995) Residents' perceptions of the evaluation process. J Gen Inter Med, 10, p. 89.
39. Kalet, A., Earp, JA and Kowlowitz, V. (1992) How well do faculty evaluate the interviewing skills of medical students?. J Gen Inter Med, 7, pp. 499-505.
40. Kassebaum, DG and Eaglen, RH (1999) Shortcoming in the evaluation of studnets' clinical skills and behaviours in medical school. Acad Med, 74, pp. 841-849.
41. Kirch, W. and Schafii, C. (1996) Misdiagnosis at a university hospital in 4 medical eras. Medicine (Baltimore), 75, pp. 29-40.
42. Kluger, AN and DeNisi, A. (1996) The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull, 119, pp. 254-284.
43. Kogan, JR, Bellin, LM and Shea, JA (2002) Implementation of the mini-CEX to evaluate medical students' clinical skills. Acad Med, 77, pp. 1156-1157.
44. Kogan, JR and Hauer, KE (2006) Brief report: Use of the mini-clinical evalaution exercise in Internal Medicine core clerkships. J Gen Inter Med, 21, pp. 501-502.
45. Little, P., Everitt, H., Williamson, I., Warner, G., Moore, M., Gould, C., Ferrier, K. and Payne, S. (2001) Observational study of effect of patient centredness and positive approach on outcomes of general practice consultations. Br Med J, 323, pp. 908-911.
46. Locke, EA and latham, GP (1990) A Theory of Goal Setting and Task Performance, Prentice Hall, Englewood Cliffs, NJ
47. Luthans, F. and Peterson, SJ (2004) 360-degree feedback with systematic coaching: Empirical analysis suggests a winning combination. Hum Res Manag, 42, pp. 243-256.
48. Maatsch, JL, Huang, R., Downing, S. and Barker, B. (1983) Predictive validity of medical specialist examinations. Final report for Grant HS 02038-04, National Center of Health Services Research, Office of Medical Education Research and Development, Michigan State University, East Lansing, MI
49. Marton, F., Dall'Alba, G. and Beaty, E. (1993) Conceptions of learning. Int. J Educ Res, 19, pp. 277-300.
50. McLeod, PJ and Meagher, TW (2001) Educational benefits of blinding students to information acquired and management plans generated by other physicians. Med Teach, 23, pp. 83-85.
51. National Health Service. (2007) Modernising Medical Careers: Foundation Programmes
52. Noel, GL, Herbers, JE, Caplow, MP, Cooper, GS, Pangaro, LN and Harvey, J. (1992) How well do Internal Medicine faculty members evaluate the clinical skills of residents?. J Gen Inter Med, 117, pp. 757-765.
53. Norcini, JJ, Blank, LL, Arnold, GK and Kimball, HR (1995) The mini-CEX (clinical evaluation exercise): A preliminary investigation. Ann Inter Med, 123, pp. 795-799.
54. Norcini, JJ, Blank, LL, Duffy, FD and Fortna, G. (2003) The mini-CEX: A method for assessing clinical skills. Ann Inter Med, 138, pp. 476-481.
55. Norcini, JJ (2007) Workplace-based assessment in clinical training. Understanding Medical Education series, Association for the Study of Medical Education, Edinburgh, UK
56. Norman, GR, Davis, D., Painvin, A., Lindsay, E., Rath, D. and Ragbeer, M. Comprehensive assessment of clinical competence of family/general physicians using multiple measures. Proceedings of the Research in Medical Education Conference, pp. 75-79.
57. Paukert, JL, Richards, ML and Olney, C. (2002) An encounter card system for increasing feedback to students. Am J Surg, 183, pp. 300-304.
58. Peterson, MC, Holbrook, JH, Hales, DV, Smith, NL and Staker, LV (1992) Contributions of the history, physical examination and laboratory investigation in making medical diagnoses. Wes J Med, 156, pp. 163-165.
59. Ramsey, P., Carline, JD, Inui, TS, Larson, EB, LoGerfo, JP and Wenrich, MD (1989) Predictive validity of certification by the American Board of Internal Medicine. Ann Inter Med, 110, pp. 719-726.
60. Ramsey, P., Wenrich, MD, Carline, JD, Inui, TS, Larson, EB and LoGerfo, JP (1993) Use of peer ratings to evaluate physician performance. J Am Med Ass, 269, pp. 1655-1660.
61. Richards, ML, Paukert, JL, Downing, SM and Bordage, G. (2007) Reliability and usefulness of clinical encounter cards for a third-year surgical clerkship. J Surg Res, 140, pp. 139-148.
62. Sadler, R. (1989) Formative assessment and the design of instructional systems. Instruct Sci, 18, pp. 119-144.
63. Shepard, LA (2000) The role of assessment in a learning culture. Educ Res, 29, pp. 4-14.
64. Small, PA, Stevens, B. and Duerson, MC (1993) Issues in medcial education: Basic problems and potential solutions. Acad Med, 68, pp. S89-S98.
65. Solomon, DJ, Reinhart, MA, Bridgham, RG, Munger, BS and Starnaman, S. (1990) An assessment of an oral examination format for evaluating clinical competence in emergency medicine. Acad Med, 65, pp. S43-S44.
66. Stillman, PL, Haley, H-L, Regan, MB and Philbin, MM (1991) Positive effects of a clinical performance assessment programme. Acad Med, 66, pp. 481-483.
67. Swanson, DB, Norman, GR and Linn, RL (1995) Performance-based assessment: Lessons from the health professions. Educ Res, 24, pp. 5-11.
68. Thomposn, T. (1998) Metamemory accuracy: Effects of feedback and the stability of individual differences. Am J Psychol, 111, pp. 33-42.
69. Turnbull, J., MacFayden, J., van Barneveld, C. and Norman, G. (2000) Clinical works sampling. A new approach to the problem of in-training evaluation. J Gen Inter Med, 15, pp. 556-561.
70. van der Vleuten, CPM (1996) The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ, 1, pp. 41-67.
71. van der Hem-Stokroos, NH, Daelmans, HE, van der Vleuten, CP, Haarman, HJ and Scherpbier, AL (2004) The impact of multi-faceted educational structuring on learning effectiveness in a surgical clerkship. Med Educ, 38, pp. 879-886.
72. Veloski, J., Boex, JR, Grasberger, J., Evans, A. and Wolfson, DB (2006) Systematic review of the literature on assessment, feedback, and physicians' clinical performance: BEME Guide No 7. Med Teach, 28, pp. 117-128.
73. Walker, J. (2001) The managerial mentor-leading productive learning in the workplace: An integral view. University of Technology Sydney Research Centre Vocational Education & Training., Productive Learning Seminar Series
74. Wenrich, MD, Carline, JD, Giles, LM and Ramsey, PG (1993) Ratings of the performance of practicing internists by hospital-based registered nurses. Acad Med, 68, pp. 680-687.
75. Whitehouse, A., Waltzman, M. and Wall, D. (2002) Pilot study of 360° assessment of personal skills to inform record of in-training assessments for senior house officers. Hosp Med, 63, pp. 172-175.
76. Winnie, PH and Butler, DL (1994) Student cognition in learning from teaching. International Encyclopedia of Education, pp. 5738-5745. Pergamon, Oxford, UK
77. Wragg, A., Wade, W., Fuller, G., Cowan, G. and Mills, P. (2003) Assessing the performance of specialist registrars. Clin Med, 3, pp. 131-134.