The retrospective pre-post: A practical method to evaluate learning from an educational program

Academic Emergency Medicine

Volumn 19, Issue 2, 2012, Pages 189-194

  Bhanji, Farhan ^a,b   Gottesman, Ronald ^a,b   De Grave, Willem ^c   Steinert, Yvonne ^b   Winer, Laura R ^b  

^a MONTREAL CHILDREN S HOSPITAL   (Canada)

^b MCGILL UNIVERSITY   (Canada)

^c MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ARTICLE; EDUCATION PROGRAM; EVALUATION; FEMALE; HUMAN; HUMAN EXPERIMENT; INTERMETHOD COMPARISON; LEARNING; MALE; MEDICAL EDUCATION; NORMAL HUMAN; PRIORITY JOURNAL; RETROSPECTIVE PRE POST METHOD; SELF EVALUATION; TRADITIONAL PRE POST DESIGN;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; EMERGENCY MEDICINE; FEMALE; HUMANS; MALE; PEDIATRICS; PROGRAM EVALUATION; RESUSCITATION; STATISTICS, NONPARAMETRIC;

EID: 84856822917     PISSN: 10696563     EISSN: 15532712     Source Type: Journal    
DOI: 10.1111/j.1553-2712.2011.01270.x     Document Type: Article

References (25)

1. Wilkes M, Bligh J,. Evaluating educational interventions. Br Med J. 1999; 318: 1269-72. (Pubitemid 29210060)
2. Kirkpatrick DL,. Evaluating Training Programs: The Four Levels. San Francisco, CA: Berrett-Koehler, 1994.
3. Morrison J,. ABC of learning and teaching in medicine: evaluation. Br Med J. 2003; 326: 385-7. (Pubitemid 36241479)
4. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L,. Accuracy of physician self-assessment compared with observed measures of competence-a systematic review. JAMA. 2006; 296: 1094-102. (Pubitemid 44343529)
5. Vnuk A, Owen H, Plummer J,. Assessing proficiency in adult basic life support: student and expert assessment and the impact of video recording. Med Teach. 2006; 28: 429-34. (Pubitemid 44446618)
6. Ward M, Gruppen L, Regehr G,. Measuring self-assessment: current state of the art. Adv Health Sci Educ. 2002; 7: 63-80. (Pubitemid 39550170)
7. D'Eon M, Sadownik L, Harrison A, Nation J,. Using self-assessments to detect workshop success. Do they work? Am J Eval. 2008; 29: 92-8.
8. Lam TCM,. Do self-assessments work to detect workshop success? An analysis of argument and recommendation by D'Eon et al. Am J Eval. 2009; 30: 93-105.
9. Cronbach LJ,. How we should measure change-or should we. Psychol Bull. 1970; 74: 68-80.
10. Levinson W, Gordon G, Skeff, K,. Retrospective versus actual pre-course self-assessments. Eval Health Profess. 1990; 13: 445-52.
11. Howard GS,. Response-shift bias-a problem in evaluating interventions with pre-post self-reports. Eval Rev. 1980; 4: 93-106.
12. Skeff KM, Stratos GA, Bergen MR,. Evaluation of a medical-faculty development program-a comparison of traditional pre/post and retrospective pre/post self-assessment ratings. Eval Health Prof. 1992; 15: 350-66. (Pubitemid 23075055)
13. Pirrallo RG, Wolff M, Simpson DE, et al., Analysis of an international emergency medical-service train-the-trainer program. Ann Emerg Med. 1995; 25: 656-9.
14. Yeazel MW, Center BA,. Demonstration of the effectiveness and acceptability of self-study module use in residency education. Med Teach. 2004; 26: 57-62. (Pubitemid 38232840)
15. Razack S, Meterissian S, Morin L, et al., Coming of age as communicators: differences in the implementation of common communications skills training in four residency programmes. Med Educ. 2007; 41: 441-9. (Pubitemid 46643020)
16. International Liaison Committee on Resuscitation. 2005 International consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Part 6: pediatric basic and advanced life support. Circulation. 2005; 112: III73-90
17. Halamek LP, Kaegi DM,. Who's teaching neonatal resuscitation to housestaff? Results of a national survey. Pediatrics. 2001; 107: 249-55. (Pubitemid 32121237)
18. Bloom BS, Engelhart MD, Furst EJ, Hill WH, Krathwohl DR,. Taxonomy of Educational Objectives: The Classification of Educational Goals: Handbook I. Cognitive Domain. New York, NY: McKay, 1956.
19. Belfield C, Thomas H, Bullock A, Eynon R, Wall D,. Measuring effectiveness for best evidence medical education: a discussion. Med Teach. 2001; 23: 164-70. (Pubitemid 32288379)
20. Kolb D, Fry R,. Towards an applied theory of experiential learning. In:, Cooper C, (ed.). Theories of Group Processes. London, UK: John Wiley, 1975.
21. Napier F, Davies RP, Baldock C, et al., Validation for a scoring system of the ALS cardiac arrest simulation test (CASTest). Resuscitation. 2009; 80: 1034-8.
22. Rodgers DL, Bhanji F, McKee BR,. Written evaluation is not a predictor for skills performance in an Advanced Cardiovascular Life Support course. Resuscitation. 2010; 81: 453-6.
23. Kramer AW, Jansen JJ, Zuithoff P, et al., Predictive validity of a written knowledge test of skills for an OSCE in postgraduate training for general practice. Med Educ. 2002; 36: 812-9. (Pubitemid 35177218)
24. Remmen R, Scherpbier A, Denekens J, et al., Correlation of a written test of skills and a performance based test: a study in two traditional medical schools. Med Teach. 2001; 23: 29-32. (Pubitemid 32054680)
25. Ram P, van der Vleuten C, Rethans JJ, Schouten B, Hobma S, Grol R,. Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice. Med Educ. 1999; 33: 197-203. (Pubitemid 29106153)