Web-assisted assessment of professional behaviour in problem-based learning: More feedback, yet no qualitative improvement?

Advances in Health Sciences Education

Volumn 17, Issue 1, 2012, Pages 81-93

  van Mook, Walther N K A ^a,b   Muijtjens, Arno M M ^b   Gorter, Simone L ^a   Zwaveling, Jan Harm ^a,c   Schuwirth, Lambert W ^b   van der Vleuten, Cees P M ^b  

^a MAASTRICHT UNIVERSITY MEDICAL CENTER   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

^c MÁXIMA MEDICAL CENTER   (Netherlands)

Author keywords

Assessment; E mail; Electronic; Peer; Problem based learning; Professional behaviour; Professionalism; Tutorial group; Web assisted

Indexed keywords

ARTICLE; BEHAVIOR; FEEDBACK SYSTEM; HUMAN; INTERNET; MEDICAL EDUCATION; MEDICAL STUDENT; NETHERLANDS; PROBLEM BASED LEARNING; PROFESSIONAL COMPETENCE; PSYCHOLOGICAL ASPECT;

BEHAVIOR; EDUCATION, MEDICAL, UNDERGRADUATE; FEEDBACK; HUMANS; INTERNET; NETHERLANDS; PROBLEM-BASED LEARNING; PROFESSIONAL COMPETENCE; STUDENTS, MEDICAL;

EID: 84856696085     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-011-9297-0     Document Type: Article

References (45)

1. Arnold, L. and D. Stern (2006). Content and context of peer assessment. In: D. T. Stern (ed.), Measuring medical professionalism. New York: Oxford University Press. ISBN-13: 978-0-19-517226-3.
2. Arnold, L., Shue, C. K., et al. (2005). Medical students' views on peer assessment of professionalism. Journal of General Internal Medicine, 20(9), 819-824.
3. Arnold, L., Willoughby, L., et al. (1981). Use of peer evaluation in the assessment of medical students. Journal of Medical Education, 56(1), 35-42.
4. Asch, E., Saltzberg, D., et al. (1998). Reinforcement of self-directed learning and the development of professional attitudes through peer- and self-assessment. Academic Medicine, 73(5), 575.
5. Branch, W. T., & Paranjape, A. (2002). Feedback and reflection: Teaching methods for clinical settings. Academic Medicine, 77(12 Pt 1), 1185-1188.
6. Centre for Excellence in Developing Professionalism (2010). Professionalism or post-professionalism? Four years of the centre for excellence. Liverpool, UK (chair H. O'Sullivan).
7. Cohen, J. (1987). Statistical power analysis for behavioral sciences. Hillsdale, NJ: Erlbaum. ISBN 0-8058-0283-5.
8. Cohen, J. J. (2006). Professionalism in medical education, an American perspective: From evidence to accountability. Medical Education, 40(7), 607-617.
9. Cruess, R., McIlroy, J. H., et al. (2006). The professionalism mini-evaluation exercise: A preliminary investigation. Academic Medicine, 81(10 Suppl), S74-S78.
10. Dannefer, E. F., Henson, L. C., et al. (2005). Peer assessment of professional competence. Medical Education, 39(7), 713-722.
11. De Leng, B. (2009). Wired for learning: How computers can support interaction in small group learning in higher education. Thesis. Mediview, Maastricht. ISBN: 978-90-77201-35-0.
12. Eva, K. W., Cunnington, J. P., et al. (2004). How can I know what I don't know? Poor self assessment in a well-defined domain. Advances in Health Sciences Education: Theory and Practice, 9(3), 211-224.
13. Eva, K. W., & Regehr, G. (2005). Self-assessment in the health professions: A reformulation and research agenda. Academic Medicine, 80(10 Suppl), S46-S54.
14. Evans, R., Elwyn, G., et al. (2004). Review of instruments for peer assessment of physicians. British Medical Association, 328(7450), 1240.
15. Fingertips http://www. fngtps. com/work. Accessed 16 Mar 2011.
16. Fowell, S. L., & Bligh, J. G. (1998). Recent developments in assessing medical students. Journal of Postgraduate Medicine, 74(867), 18-24.
17. Freedman, J. A., Lehmann, H. P., et al. (2000). Web-based peer evaluation by medical students. Academic Medicine, 75(5), 539-540.
18. Hojat, M., & Xu, G. (2004). A visitor's guide to effect sizes: Statistical significance versus practical (clinical) importance of research findings. Advances in Health Sciences Education: Theory and Practice, 9(3), 241-249.
19. Lurie, S. J., Nofziger, A. C., et al. (2006a). Effects of rater selection on peer assessment among medical students. Medical Education, 40(11), 1088-1097.
20. Lurie, S. J., Nofziger, A. C., et al. (2006b). Temporal and group-related trends in peer assessment amongst medical students. Medical Education, 40(9), 840-847.
21. Mazor, K. M., Canavan, C., et al. (2008). Collecting validity evidence for an assessment of professionalism: Findings from think-aloud interviews. Academic Medicine, 83(10 Suppl), S9-S12.
22. Mazor, K., Clauser, B. E., et al. (2007). Evaluation of missing data in an assessment of professional behaviors. Academic Medicine, 82(10 Suppl), S44-S47.
23. McKinstry, B. (2007). BEME guide no 10: A systematic review of the literature on the effectiveness of self-assessment in clincal education. http://www. bemecollaboration. org/beme/files/BEME%20Guide%20No%2010/BEMEFinalReportSA240108. pdf. Accessed October 10th 2008.
24. National Board of Medical Examiners (2010). Assessment of professional behaviors program. http://www. nbme. org/schools/apb/index. html. Accessed September 24th 2010.
25. Papadakis, M. A., Arnold, G. K., et al. (2008). Performance during internal medicine residency training and subsequent disciplinary action by state licensing boards. Annals of Internal Medicine, 148(11), 869-876.
26. Papadakis, M. A., Teherani, A., et al. (2005). Disciplinary action by medical boards and prior behavior in medical school. he New England Journal of Medicine, 353(25), 2673-2682.
27. Pendleton, D., & Schofield, T., et al. (1984). A method for giving feedback. In: The consultation: An approach to learning and teaching. Oxford: Oxford University Press, pp. 68-71.
28. Project Team Consilium Abeundi van Luijk, S. J. e. (2005). Professional behaviour: Teaching, assessing and coaching students. Final report and appendices. Mosae Libris.
29. Ramsey, P. G., Wenrich, M. D., et al. (1993). Use of peer ratings to evaluate physician performance. The Journal of the American Medical Association, 269(13), 1655-1660.
30. Rees, C., & Shepherd, M. (2005). Students' and assessors' attitudes towards students' self-assessment of their personal and professional behaviours. Medical Education, 39(1), 30-39.
31. Schuwirth, L. W., & van der Vleuten, C. P. (2004). Changing education, changing assessment, changing research? Medical Education, 38(8), 805-812.
32. Shue, C. K., Arnold, L., et al. (2005). Maximizing participation in peer assessment of professionalism: The students speak. Academic Medicine, 80(10 Suppl), S1-S5.
33. Singer, P. A., Robb, A., et al. (1996). Performance-based assessment of clinical ethics using an objective structured clinical examination. Academic Medicine, 71(5), 495-498.
34. SPSS, Inc. (2007). SPSS 16. 0. 1.
35. Stark, R., Korenstein, D., et al. (2008). Impact of a 360-degree professionalism assessment on faculty comfort and skills in feedback delivery. Journal of General Internal Medicine, 23(7), 969-972.
36. Tabuenca, A., Welling, R., et al. (2007). Multi-institutional validation of a web-based core competency assessment system. Journal of Surgery Education, 64(6), 390-394.
37. van der Vleuten, C. P., & Schuwirth, L. W. (2005). Assessing professional competence: From methods to programmes. Medical Education, 39(3), 309-317.
38. van Luijk, S., Gorter, R., et al. (2010). Promoting professional behaviour in undergraduate medical, dental and veterinary curricula in the Netherlands: Evaluation of a joint effort. Medical Teacher, 32, 733-739.
39. van Luijk, S. J., Smeets, S. G. E., et al. (2000). Assessing professional behaviour and the role of academic advice at the Maastricht Medical School. Medical Teacher, 22(2), 168-172.
40. van Mook, W. N., de Grave, W. S., et al. (2007). Factors inhibiting assessment of students' professional behaviour in the tutorial group during problem-based learning. Medical Education, 41(9), 849-856.
41. van Mook, W., de Grave, W., et al. (2009a). Professionalism: Evolution of the concept. European Journal of Internal Medicine, 20, e81-e84.
42. van Mook, W., Gorter, S., et al. (2009b). Approaches to professional behaviour assessment: Tools in the professionalism toolbox. European Journal of Internal Medicine, 20, e153-e157.
43. van Mook, W. N., van Luijk, S. J., et al. (2010). Combined formative and summative professional behaviour assessment approach in the bachelor phase of medical school: A Dutch perspective. Medical Teacher, 32, e517-531.
44. van Mook, W., van Luijk, S., et al. (2009c). The concepts of professionalism and professional behaviour: Conflicts in both definition and learning outcomes. European Journal of Internal Medicine, 20, e85-e89.
45. Wheeler, D. W., Whittlestone, K. D., et al. (2003). A web-based system for teaching, assessment and examination of the undergraduate peri-operative medicine curriculum. Anaesthesia, 58(11), 1079-1086.