Kirkpatrick's levels and education 'evidence'

Medical Education

Volumn 46, Issue 1, 2012, Pages 97-106

  Yardley, Sarah ^a   Dornan, Tim ^b  

^a KEELE UNIVERSITY SCHOOL OF MEDICINE   (United Kingdom)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EMPIRICAL RESEARCH; EVALUATION; EVIDENCE BASED MEDICINE; HUMAN; LEARNING; MEDICAL EDUCATION; MEDICAL RESEARCH; METHODOLOGY; STANDARD; TOTAL QUALITY MANAGEMENT;

BIOMEDICAL RESEARCH; CLINICAL COMPETENCE; EDUCATION, MEDICAL; EMPIRICAL RESEARCH; EVALUATION STUDIES AS TOPIC; EVIDENCE-BASED MEDICINE; HUMANS; LEARNING; QUALITY IMPROVEMENT;

EID: 83455179219     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2011.04076.x     Document Type: Review

References (41)

1. Jason H. The importance - and limits - of best evidence medical education. Educ Health 2000;13:9-14.
2. Kirkpatrick J, Kirkpatrick W. Kirkpatrick, Then and Now: A Strong Foundation for the Future. St Louis, MO: Kirkpatrick Partners 2009.
3. Kirkpatrick DL. Evaluation of training. In: Craig R, Bittel L, eds. Training and Development Handbook. New York, NY: McGraw-Hill 1967;87-112.
4. Heron J, Reason P. The practice of co-operative enquiry: research with rather than on people. In: Reason P, Bradbury H, eds. Handbook of Action Research: the Concise Paperback Edition London: Sage 2006;144-54.
5. Heron J. Co-operative Inquiry: Research into the Human Condition. London: Sage Publications 1996;1-125.
6. Oates BJ. Cooperative enquiry: reflections on practice. Electron J Bus Res Meth 2002;1:27-37.
7. Reason P. The practice of cooperative inquiry. Syst Pract Action Res 2002;15:169-76.
8. Holt NL. Representation, legitimation, and autoethnography: an autoethnographic writing story. Intern J Qualitative Meth 2003;2 (1):18-28.
9. Dornan T, Littlewood S, Margolis S, Scherpbier A, Spencer J, Ypinazar V. How can experience in clinical and community settings contribute to early medical education? A BEME systematic review. Med Teach 2006;28:3-18.
10. Yardley S, Littlewood S, Margolis SA, Scherpbier A, Spencer J, Ypinazar V, Dornan T. What has changed in the evidence of early experience? Update of a BEME systematic review. Med Teach 2010;32:740-6.
11. Alliger GM, Janak EA. Kirkpatrick's levels of training criteria: thirty years later. Pers Psychol 1989;42:331-42.
12. Abernathy DJ. Thinking outside the evaluation box. Train Dev 1999;53:18-23.
13. Blanchard PN, Thacker JW, Way SA. Training evaluation: perspectives and evidence from Canada. Int J Train Dev 2000;4:295-304.
14. Holton EF. The flawed four-level evaluation model. Hum Res Develop Quart 1996;7:5-21.
15. Dornan T, Peile E, Spencer J. On 'evidence'. Med Educ 2008;42:232-3.
16. Best Evidence Medical Education (BEME) Steering Group. Guide for topic review groups on carrying out BEME systematic reviews. 2003; [Accessed 21 October 2010].
17. Wikipedia. Hierarchy of evidence. [Accessed 21 October 2010].
18. Todres M, Stephenson A, Jones R. Medical education research remains the poor relation. BMJ 2007;335:333-5.
19. Stephenson A, Todres M, Jones R. Reply to Dornan etal.'s 'On evidence'. Med Educ 2009;43:390-1.
20. Cherry MG, Brown JM, Neal T, Shaw NB. What features of educational interventions lead to competence in aseptic insertion and maintenance of CV catheters in acute care? BEME Guide No. 15. Med Teach 2010;32:198-218.
21. Overeem K, Faber MJ, Arah OA, Elwyn G, Lombarts KMJMH, Wollersheim HC, Grol RP. Doctor performance assessment in daily practice: does it help doctors or not? A systematic review. Med Educ 2007;41:1039-49.
22. Hill AG, Uu CBM, Hattie J. A systematic review of resident-as-teacher programmes. Med Educ 2009;43:1129-40.
23. Cook DA, Bordage G, Schmidt HG. Description, justification and clarification: a framework for classifying the purposes of research in medical education. Med Educ 2008;42:128-33.
24. Zorzi A, Rourke J, Kennard M, Peterson M, Miller K. Combined research and clinical learning make rural summer studentship programme a successful model. Education for Health 2005;18:329-37.
25. Vieira JE, Nunes MdPT, Martins MdA. Directing student response to early patient contact by questionnaire. Med Educ 2003;37:119-25.
26. Gutierrez MC, Soto RG. Alligator attack: an illustration of the impact of early clinical exposure. Med Educ 2002;36:1182-4.
27. Cochrane A. Effectiveness and Efficiency: Random Reflections on Health Services. London: Nuffield Provincial Hospitals NHS Trust 1972;1-92.
28. Pope C, Mays N, Popay J. Synthesising Qualitative and Quantitative Health Evidence. Maidenhead: Open University Press 2007;1-224.
29. Eva K. Broadening the debate about quality in medical education research. Med Educ 2009;43:294-6.
30. Guba EG, Lincoln YS. Paradigmatic controversies, contradictions, and emerging confluences. In: Denzin NK, Lincoln YS, eds. The Sage Handbook of Qualitative Research, 3rd edn. Thousand Oaks, CA: Sage Publications 2005;191-215.
31. Pawson R. Evidence-Based Policy. A Realist Perspective. London: Sage Publications 2006;1-96.
32. Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005;27:10-28.
33. Steinert Y, Mann K, Centeno A, Dolmans D, Spencer J, Gelula M, Prideaux D. A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach 2006;28:497-526.
34. Hammick M, Freeth D, Koppel I, Reeves S, Barr H. A best evidence systematic review of interprofessional education: BEME Guide No. 9. Med Teach 2007;29:735-51.
35. Driessen E, van Tartwijk J, van der Vleuten C, Wass V. Portfolios in medical education: why do they meet with mixed success? Med Educ 2007;41:1224-33.
36. Colthart I, Bagnall G, Evans A, Allbutt H, Haig A, Illing J, McKinstry B. The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice. BEME Guide No. 10. Med Teach 2008;30:124-45.
37. Tochel C, Haig A, Hesketh A, Cadzow A, Beggs K, Colthart I, Peacock H. The effectiveness of portfolios for postgraduate assessment and education: BEME Guide No. 12. Med Teach 2009;31:299-318.
38. Buckley S, Coleman J, Davison I, et al. The education effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach 2009;31:282-98.
39. Wong G, Greenhalgh T, Pawson R. Internet-based medical education: a realist review of what works, for whom, and in what circumstances. BMC Med Educ 2010;10 (12).
40. Wong B, Etchells E, Kuper A, Levinson W, Shojania KG. Teaching quality improvement and patient safety to trainees: a systematic review. Acad Med 2010;85:1425-39.
41. Miller A, Archer J. Impact of workplace-based assessment on doctors' education and performance: a systematic review. BMJ 2010;341:c5064.