Estimating learning outcomes from pre-and posttest student self-assessments: A longitudinal study

Academic Medicine

Volumn 88, Issue 3, 2013, Pages 369-375

  Schiekirka, Sarah ^a   Reinhardt, Deborah ^a   Beibarth, Tim ^a   Anders, Sven ^b   Pukrop, Tobias ^a   Raupach, Tobias ^a  

^a UNIVERSITY MEDICAL CENTER GÖTTINGEN   (Germany)

^b UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84874950852     PISSN: 10402446     EISSN: 1938808X     Source Type: Journal    
DOI: 10.1097/ACM.0b013e318280a6f6     Document Type: Article

References (29)

1. McOwen KS, Bellini LM, Morrison G, Shea JA. The development and implementation of a health-system-wide evaluation system for education activities: Build it and they will come. Acad Med. 2009;84:1352-1359.
2. Gibson KA, Boyle P, Black DA, Cunningham M, Grimm MC, McNeil HP. Enhancing evaluation in an undergraduate medical education program. Acad Med. 2008;83: 787-793.
3. Blumberg P. Multidimensional outcome considerations in assessing the efficacy of medical educational programs. Teach Learn Med. 2003;15:210-214.
4. Raupach T, Münscher C, Beissbarth T, Burckhardt G, Pukrop T. Towards outcomebased programme evaluation: Using student comparative self-assessments to determine teaching effectiveness. Med Teach. 2011;33:e446-e453.
5. Colthart I, Bagnall G, Evans A, et al. The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME guide no. 10. Med Teach. 2008;30: 124-145.
6. Falchikov N, Boud D. Student self-assessment in higher education: A meta-analysis. Rev Educ Res. 1989;59:395-430.
7. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review. JAMA. 2006;296:1094-1102.
8. Regehr G, Hodges B, Tiberius R, Lofchy J. Measuring self-assessment skills: An innovative relative ranking model. Acad Med. 1996;71(10 suppl):S52-S54.
9. Eva KW, Regehr G. Self-assessment in the health professions: A reformulation and research agenda. Acad Med. 2005;80(10 suppl):S46-S54.
10. Fitzgerald JT, White CB, Gruppen LD. A longitudinal study of self-assessment accuracy. Med Educ. 2003;37:645-649.
11. Gordon MJ. A review of the validity and accuracy of self-assessments in health professions training. Acad Med. 1991; 66:762-769.
12. Ward M, Gruppen L, Regehr G. Measuring self-assessment: Current state of the art. Adv Health Sci Educ Theory Pract. 2002;7:63-80.
13. Rozenblit L, Keil F. The misunderstood limits of folk science: An illusion of explanatory depth. Cogn Sci. 2002;26:521-562.
14. Mandel LS, Goff BA, Lentz GM. Self-assessment of resident surgical skills: Is it feasible? Am J Obstet Gynecol. 2005;193:1817-1822.
15. Lam TCM. Do self-assessments work to detect workshop success? Am J Eval. 2009;30:93-105.
16. Hayman J, Rayder N, Stenner AJ, Madey DL. On aggregation, generalization, and utility in educational evaluation. Educ Eval Policy Anal. 1979;1:31-39.
17. D'Eon MF, Eva KW. Self-assessments for workshop evaluations. Am J Eval. 2009;30:259-261.
18. Chenot JF. Undergraduate medical education in Germany. Ger Med Sci. April 2, 2009;7:Doc02.
19. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29-36.
20. Cook NR. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation. 2007;115:928-935.
21. Schiekirka S, Reinhardt D, Heim S, et al. Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school. BMC Med Educ. 2012;12(45).
22. Kogan JR, Shea JA. Course evaluation in medical education. Teach Teach Educ. 2007;23:251-264.
23. Herzig S, Marschall B, Nast-Kolb D, Soboll S, Rump LC, Higgers RD. Distribution of government funds according to teaching performance. A position paper of the associate deans for medical education in North Rhine-Westphalia. GMS Z Med Ausbild. 2007;24:Doc109.
24. Möltner A, Duelli R, Resch F, Schultz J-H, Jünger J. School-specific assessment in German medical schools. GMS Z Med Ausbild. 2010;27:Doc44.
25. D'Eon M, Sadownik L, Harrison A, Nation J. Using self-assessments to detect workshop success. Am J Eval. 2008;29:92-98.
26. Thompson BM, Rogers JC. Exploring the learning curve in medical education: Using self-assessment as a measure of learning. Acad Med. 2008;83(10 suppl): S86-S88.
27. Raupach T, Schiekirka S, Münscher C, et al. Piloting an outcome-based programme evaluation tool in undergraduate medical education. GMS Z Med Ausbild. 2012;29:Doc44.
28. Skeff KM, Stratos GA, Bergen MR. Evaluation of a medical faculty development program. Eval Health Prof. 1992;15:350-366.
29. Raupach T, Hanneforth N, Anders S, Pukrop T, Th J ten Cate O, Harendza S. Impact of teaching and assessment format on electrocardiogram interpretation skills. Med Educ. 2010;44:731-740.