Quality of feedback following performance assessments: Does assessor expertise matter?

European Journal of Training and Development

Volumn 37, Issue 1, 2013, Pages 105-125

  Govaerts, Marjan J B ^a   van de Wiel, Margje W J ^a   van der Vleuten, Cees P M ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Feedback; Performance assessment; Performance development; Performance management; Professional training

Indexed keywords

EID: 84873043686     PISSN: 20469012     EISSN: 20469020     Source Type: Journal    
DOI: 10.1108/03090591311293310     Document Type: Article

References (49)

1. Aguinis, H. (2009), "An expanded view of performance management" in Smither, J.W. and London, M. (Eds.), Performance Management: Putting Research into Action, Jossey-Bass, San Francisco CA, pp. 1-43.
2. Aguinis, H. and Pierce, C.A. (2008), "Enhancing the relevance of organizational behavior by embracing performance management research" in Journal of Organizational Behavior, Vol. 29, No. 1, pp. 139-45.
3. Alvero, A.M., Bucklin, B.R. and Austin, J. (2001), "An objective review of the effectiveness and essential characteristics of performance feedback in organizational settings" in Journal of Organizational Behavior Management, Vol. 21, No. 1, pp. 3-29.
4. Arts, J.A.R.M., Gijselaers, W.H. and Boshuizen, H.P.A. (2006), "Understanding managerial problem-solving, knowledge use and information processing: investigating stages from school to the workplace" in Contemporary Educational Psychology, Vol. 31, No. 4, pp. 387-410.
5. Barbour, R.S. (2001), "Checklists for improving rigour in qualitative research. A case of the tail wagging the dog?" in British Medical Journal, Vol. 322, pp. 1115-7.
6. Black, P. and Wiliam, D. (1998), "Assessment and classroom learning" in Assessment in Education: Principles, Policy & Practice, Vol. 5, No. 1, pp. 7-74.
7. Boud, D. and Falchikov, N. (2007), Rethinking Assessment in Higher Education. Learning for the Longer Term, Routledge, New York, NY.
8. Bransford, J.D. and Schwartz, D.L. (2009), "It takes expertise to make expertise: some thoughts about why and how and reflections on the themes in chapters 15-18" in Ericsson, K.A. (Ed.), Development of Professional Expertise: Toward Measurement of Expert Performance and Design of Optimal Learning Environments, Cambridge University Press, New York, NY, pp. 432-48.
9. Brutus, S. (2010), "Words versus numbers: a theoretical exploration of giving and receiving narrative comments in performance appraisal" in Human Resource Management Review, Vol. 20, No. 2, pp. 144-57.
10. Canavan, C., Holtman, M.C., Richmond, M. and Katsufrakis, P.J. (2010), "The quality of written comments on professional behaviors in a developmental multisource feedback program" in Academic Medicine, Vol. 85, No. 10, pp. S106-9.
11. Chi, M. (1997), "Quantifying qualitative analyses of verbal data: a practical guide" in The Journal of the Learning Sciences, Vol. 6, No. 3, pp. 271-315.
12. Chi, M.T.H. (2006), "Two approaches to the study of experts' characteristics" in Ericsson, K.A., Charness, N., Feltovich, P.J. and Hoffman, R.R. (Eds.), The Cambridge Handbook of Expertise and Expert Performance, Cambridge University Press, Cambridge, pp. 21-30.
13. DeNisi, A.S. (1996), Cognitive Approach to Performance Appraisal: A Program of Research, Routledge, New York, NY.
14. DeNisi, A.S. and Williams, K.J. (1988), "Cognitive approaches to performance appraisal" Ferris, G. and Rowland, K. (Eds.), Research in Personnel and Human Resource Management, Vol. 6, JAI Press, Greenwich, CT.
15. Dudek, N.L., Marks, M.B. and Regehr, G. (2005), "Failure to fail: the perspectives of clinical supervisors" in Academic Medicine, Vol. 80, 10, suppl., pp. S84-7.
16. Durning, S.J., Artino, A.R., Boulet, J.R., Dorrance, K., Van der Vleuten, C.P.M. and Schuwirth, L.W.T. (2012), "The impact of selected contextual factors on experts' clinical reasoning performance (does context impact clinical reasoning performance in experts?)" in Advances in Health Sciences Education, Vol. 17, No. 1, pp. 65-79.
17. Elo, S. and Kyngäs, H. (2008), "The qualitative content analysis process" in Journal of Advanced Nursing, Vol. 62, No. 1, pp. 107-15.
18. Ericsson, K.A. (2009), Development of Professional Expertise: Toward Measurement of Expert Performance and Design of Optimal Learning Environments, Cambridge University Press, New York, NY.
19. Feldman, J.M. (1981), "Beyond attribution theory: cognitive processes in performance appraisal" in Journal of Applied Psychology, Vol. 66, No. 2, pp. 127-48.
20. Ferris, G.R., Munyon, T.P., Basik, K. and Buckley, M.R. (2008), "The performance evaluation context: social, emotional, cognitive, political and relationship components" in Human Resource Management Review, Vol. 18, No. 3, pp. 146-63.
21. Finney, T.G. (2010), "Performance appraisal comments: the practitioner's dilemma" in The Coastal Business Journal, Vol. 9, No. 1, pp. 60-9.
22. Forgas, J.P. (2002), "Feeling and doing: influences on interpersonal behaviour" in Psychological Inquiry, Vol. 13, No. 1, pp. 1-28.
23. Forgas, J.P. and George, J.M. (2001), "Affective influences on judgments and behavior in organizations: an information processing perspective" in Organizational Behavior and Human Decision Processes, Vol. 86, No. 1, pp. 3-34.
24. Govaerts, M., Van der Vleuten, C. and Schuwirth, L. (2005), "The use of observational diaries in in-training evaluations: student perceptions" in Advances in Health Sciences Education, Vol. 10, No. 3, pp. 171-88.
25. Govaerts, M.J.B., Schuwirth, L.W.T., van der Vleuten, C.P.M. and Muijtjens, A.M.M. (2011), "Workplace-based assessments: effects of rater expertise" in Advances in Health Sciences Education, Vol. 16, No. 2, pp. 151-65.
26. Govaerts, M.J.B., Van de Wiel, M.W.J., Schuwirth, L.W.T., Van der Vleuten, C.P.M. and Muijtjens, A.M.M. (2012), "Raters' performance theories and constructs in workplace-based assessments", Advances in Health Sciences Education, May, DOI: 10.1007/s10459-012-9376-x.
27. Hamlin, B. and Stewart, J. (2011), "What is HRD? A definitional review and synthesis of the HRD domain" in Journal of European Industrial Training, Vol. 35, No. 3, pp. 199-220.
28. Hattie, J. and Timperley, H. (2007), "The power of feedback" in Review of Educational Research, Vol. 77, No. 1, pp. 81-112.
29. Holmboe, E.S., Sherbino, J., Long, D.M., Swing, S.R. and Frank, J.R. (2010), "The role of assessment in competency-based medical education" in Medical Teacher, Vol. 32, No. 8, pp. 676-82.
30. Hounsell, D. (2007), "Towards more sustainable feedback to students" in Boud, D. and Falchikov, N. (Eds.), Rethinking Assessment in Higher Education. Learning for the Longer Term, Routledge, New York, NY, pp. 101-13.
31. Kerrins, J.A. and Cushing, K.S. (2000), "Taking a second look: expert and novice differences when observing the same classroom teaching segment a second time" in Journal of Personnel Evaluation in Education, Vol. 14, No. 1, pp. 5-24.
32. Kitto, S.C., Chesters, J. and Grbich, C. (2008), "Quality in qualitative research" in Medical Journal of Australia, Vol. 188, No. 4, pp. 243-6.
33. Kluger, A.N. and DeNisi, A. (1996), "The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory" in Psychological Bulletin, Vol. 119, No. 2, pp. 254-84.
34. Latham, G., Almost, J., Mann, S. and Moore, C. (2005), "New developments in performance management" in Organizational Dynamics, Vol. 34, No. 1, pp. 77-87.
35. Lievens, F. (2001), "Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity" in Journal of Applied Psychology, Vol. 86, No. 2, pp. 255-64.
36. Luthans, F. and Peterson, S.J. (2003), "360-degree feedback with systematic coaching: empirical analysis suggests a winning combination" in Human Resource Management, Vol. 42, No. 3, pp. 243-56.
37. Murphy, K.R. and Cleveland, J.N. (1995), Understanding Performance Appraisal. Social, Organizational and Goal-based Perspectives, Sage Publications, Thousand Oaks, CA.
38. Murphy, K.R., Cleveland, J.N., Skattebo, A.L. and Kinney, T.B. (2004), "Raters who pursue different goals give different ratings" in Journal of Applied Psychology, Vol. 89, No. 1, pp. 158-64.
39. Norman, G., Eva, K., Brooks, L. and Hamstra, S. (2006), "Expertise in medicine and surgery" in Ericsson, K.A., Charness, N., Feltovich, P.J. and Hoffman, R.R. (Eds.), The Cambridge Handbook of Expertise and Expert Performance, Cambridge University Press, Cambridge, pp. 339-54.
40. Overeem, K., Lombarts, M., Arah, O., Klazinga, N., Grol, R. and Wollersheim, H. (2010), "Three methods of multi-source feedback compared: a plea for narrative comments and coworkers' perspectives" in Medical Teacher, Vol. 32, No. 2, pp. 141-7.
41. Ramaprasad, A. (1983), "On the definition of feedback" in Behavioural Science, Vol. 28, No. 1, pp. 4-13.
42. Salas, E. and Rosen, M.A. (2010), "Experts at work: principles for developing expertise in organizations" in Kozlowski, S.W.J. and Salas, E. (Eds.), Learning, Training, and Development in Organizations, Routledge/Taylor & Francis, New York, NY, pp. 99-134.
43. Shute, V.J. (2008), "Focus on formative feedback" in Review of Educational Research, Vol. 78, No. 1, pp. 153-89.
44. Smither, J.W. and Walker, A.G. (2004), "Are the characteristics of narrative comments related to improvement in multirater feedback over time?" in Journal of Applied Psychology, Vol. 89, No. 3, pp. 575-81.
45. Smither, J.W., London, M. and Reilly, R.R. (2005), "Does performance improve following multisource feedback? A theoretical mode, meta-analysis and review of empirical findings" in Personnel Psychology, Vol. 58, No. 1, pp. 33-66.
46. Van de Ridder, M., Stokking, K., McGaghie, W. and Ten Cate, O. (2008), "What is feedback in clinical education?" in Medical Education, Vol. 42, No. 2, pp. 189-97.
47. Van de Wiel, M.W.J., Van den Bossche, P. and Koopmans, R.P. (2011), "Deliberate practice, the high road to expertise: K.A. Ericsson" in Dochy, F., Gijbels, D., Segers, M. and Van den Bossche, P. (Eds.), Theories of Learning for the Workplace: Building Blocks for Training and Professional Development Programs, Routledge, London, pp. 1-16.
48. van der Vleuten, C.P.M., Schuwirth, L.W.T., Scheele, F., Driessen, E.W. and Hodges, B. (2010), "The assessment of professional competence: building blocks for theory development" in Best Practices & Research Clinical Obstetrics and Gynaecology, Vol. 24, No. 6, pp. 703-19.
49. Wiliam, D. (2007), "Keeping learning on track: classroom assessment and the regulation of learning" in Lester, F.K. Jr (Ed.), Second Handbook of Mathematics Teaching and Learning, Information Age Publishing, Greenwich, CT, pp. 1053-98.