A literature review of multi-source feedback systems within and without health services, leading to 10 tips for their successful design

Medical Teacher

Volumn 28, Issue 7, 2006, Pages

  Wood, Laurence ^a   Hassell, Andrew ^a   Whitehouse, Andrew ^a   Bullock, Alison ^b   Wall, David ^a  

^a West Midlands Deanery   (United Kingdom)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CONTENT VALIDITY; EDUCATION PROGRAM; HEALTH SERVICE; HUMAN; INTERPERSONAL COMMUNICATION; JOB PERFORMANCE; MEDICAL EDUCATION; MEDICAL PRACTICE; PHYSICIAN ATTITUDE; PREDICTIVE VALIDITY; RELIABILITY; REVIEW; TEAMWORK; WORKPLACE;

CLINICAL COMPETENCE; EMPLOYEE PERFORMANCE APPRAISAL; FEEDBACK; GREAT BRITAIN; HUMANS; ORGANIZATIONAL CULTURE; PHYSICIAN'S PRACTICE PATTERNS; QUALITY OF HEALTH CARE; STATE MEDICINE;

EID: 34250893107     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.1080/01421590600834286     Document Type: Review

References (81)

1. Alimo-Metcalfe, B. (1998) 360° feedback and leadership development. International Journal of Selection and Assessment, 6:1, pp. 35-44.
2. Archer, JC, Norcini, J. and Davies, H. (2005) Use of SPRAT for peer review of paediatricians in training. British Medical Journal, 330, pp. 1251-1253.
3. Atwater, L. and Waldman, D. (1998) Accountability in 360° feedback. Human Resources Magazine, 43:6, pp. 96-102.
4. Barclay, J. and Harland, L. (1995) Peer performance appraisals: The impact of rater competence, rater location and rating correctability on fairness perceptions. Group and Organization Management, 20:1, pp. 39-60.
5. Becker, T. and Klimoski, R. (1989) A field study of the relationship between the organizational feedback environment and performance. Personnel Psychology, 42, pp. 343-358.
6. Bernardin, H., Dahmus, S. and Redmon, G. (1993) Attitudes of first-line supervisors toward subordinate appraisals. Human Resource Management, 32:2, pp. 315-324.
7. Bettenhausen, K. and Fedor, D. (1997) Peer and upward appraisals: A comparison of their benefits and problems. Group and Organization Management, 22:2, pp. 236-263.
8. Bilsbury, N. (1998) Academy of Human Resource Development Conference Proceedings. A case study: Employee perceptions of the efficacy of 360 degree feedback at a large Midwestern utility, Academy of Human Resources Development, Oak Brook, IL
9. Bracken, D., Summers, L. and Fleenor, J. (1998) High-tech 360°. Training and Development, 52:8, pp. 42-46.
10. Butterfield, OS and Pearson, JA (1990) Nurses in resident evaluation: A qualitative study of the participants' perspectives. Evaluation and the Health Professions, 13, pp. 453-473.
11. Butterfield, PS and Mazzaferri, EL (1991) A new rating form for use by nurses in assessing residents' humanistic behaviour. Journal of General Internal Medicine, 6, pp. 155-161.
12. Cardy, R. and Dobbins, G. (1994) Performance Appraisal: Alternative Perspectives, South-Western Publishing, Cincinnati, OH
13. Carline, JD, Wenrick, M. and Ramsey, PG (1989) Characteristics of ratings of physician competence by professional associates. Evaluation and the Health Professions, 12, pp. 409-423.
14. Church, A. and Bracken, D. (1997) Advancing the state-of-the-art of 360° feedback: Guest editors' comments on the research and practice of multi-rater assessment methods. Group and Organization Management, 22:2, pp. 149-161.
15. Church, AH (2000) Do higher performing managers actually receive better ratings? a validation of multirater assessment methodology. Consulting Psychology Journal: Practice and Research, 52, pp. 99-116.
16. Crossley, T. and Taylor, I. (1995) Developing competitive advantage through 360° feedback. American Journal of Management Development, 1:1, pp. 6-17.
17. Davidge, AM and Hull, A. L. (1980) A system for the evaluation of medical students' clinical competence. Journal of Medical Education, 55, pp. 65-67.
18. Dawson-Saunders, B. and Paiva, REA (1986) The validity of clerkship performance evaluations. Medical Education, 20, pp. 240-245.
19. DeSimone, R. (1998) Establishing the link: Relating a 360 degree management assessment and development process to the bottom line. Health Care Supervisor, 17, pp. 31-36.
20. Dielman, TE, Hull, AL and Davis, WK (1980) Psychometric properties of clinical performance ratings. Evaluation and the Health Professions, 3, pp. 103-117.
21. Dominick, P., Reilly, R. and McGourty, J. (1997) The effects of peer feedback on team member behaviour. Group and Organization Management, 22:4, pp. 508-520.
22. Druskatt, V. and Wolff, S. (1999) Effects and timing of developmental peer appraisals in self-managing work groups. Journal of Applied Psychology, 84:1, pp. 58-74.
23. Edwards, M. and Ewen, A. (1996) 360°, Feedback: The Powerful New Model for Employee Assessment and Performance Improvement, AMACOM, New York
24. Evans, R., Elwyn, G. and Edwards, A. (2004) Review of instruments for peer assessment of physicians. British Medical Journal, 328, pp. 1240-1243.
25. Facteau, CL, Facteau, CD, Schoel, LC, Russell, EA and Poteet, ML (1998) Reactions of leaders to 360-degree feedback from subordinates and peers. Leadership Quarterly, 9:4, pp. 427-448.
26. Farh, J. and Dobbins, G. (1989) Effects of self-esteem on leniency bias in self-reports of performance: A structural equation model analysis. Personnel Psychology, 42, pp. 835-850.
27. Fedor, D. and Bettenhausen, K. (1989) The impact of purpose, participant preconceptions and rating level on the acceptance of peer evaluations. Group and Organization Studies, 14:2, pp. 182-197.
28. Fletcher, C. (1999) The implications of research on gender differences in self-assessment and 360 degree appraisal. Human Resource Management, 9:1, pp. 39-46.
29. Folger, R. and Cropanzano, R. (1998) Organizational justice and performance evaluation: Test and trial measures. Organizational Justice and Human Resource Management, Sage Publications, Beverly Hills, CA
30. Garavan, T., Morley, M. and Flynn, M. (1997) 360-degree feedback: Its role in employee development. Journal of Management Development, 13:2, pp. 134-148.
31. General Medical Council (2001) Good Medical Practice, GMC, London
32. Ghorpade, J. (2000) Managing five paradoxes of 360-degree feedback. Academy of Management Executive, 14, pp. 140-150.
33. Handy, L., Devine, M. and Heath, L. (1996) 360° Feedback: Unguided Missile or Powerful Weapon?, Ashridge Management Research Group, Berkhamsted
34. Hautaluoma, J., Jobe, L., Visser, S. and Donkersgoed, W. (1992) Employee reactions to different upward feedback methods
35. Hazucha, J., Hezlett, S. and Schneider, R. (1993) The impact of 360-degree feedback on management skills development. Human Resource Management, 32:2, pp. 325-351.
36. Hoffman, R. (1995) Ten reasons why you should be using 360-degree feedback. Human Resources Magazine, 40, pp. 82-86.
37. Ilott, I. and Bunch, G. (1980) Competencies of basic surgical trainees. Annals of the Royal College of Surgeons of England, 1, pp. 14-16.
38. Kanouse, D. (1998) Why multi-rater feedback systems fail?. Human Resources Focus, 75, pp. 3-4.
39. Kaplan, R. (1993) 360° feedback PLUS: Boosting the power of co-worker ratings for executives. Human Resource Management, 32:2, pp. 299-314.
40. Keck, JW (1979) Efficacy of cognitive/non cognitive measures in predicting resident physician performance. Journal of Medical Education, 54, pp. 759-765.
41. Keeping, L., Levy, P. and Brown, D. (1999) Examining Self-Appraisal Formality and Expectations on Appraisal Reactions, GA, Society for Industrial and Organizational Psychology, Atlanta
42. Lepsinger, R. and Lucia, A. (1998) Creating champions for 360° feedback. Training and Development, 52:2, pp. 49-53.
43. Lindsey, E., Holmes, V. and McCall, M. (1997) Key Events in Executives' Lives, Centre for Creative Leadership, Greensboro, NC
44. Linn, BS, Arostegui, M. and Zeppa, R. (1975) Performance self assessment. British Journal of Medical Education, 9, pp. 98-101.
45. London, M. and Beatty, R. (1993) 360° feedback as a competitive advantage. Human Resource Management, 32:2, pp. 353-372.
46. London, M., Larsen, H. and Thisted, L. (1999) Relationships between feedback and self-development. Group and Organization Management, 24:1, pp. 5-27.
47. London, M. and Smither, J. (1995) Can multi-source feedback change perceptions of goal accomplishment, self-evaluations and performance-related outcomes? Theory-based applications and directions for research. Personnel Psychology, 48:4, pp. 803-839.
48. London, M., Wohlers, A. and Gallagher, P. (1990) 360° feedback surveys: A source of feedback to guide management development. Journal of Management Development, 9, pp. 17-31.
49. Mabe, P. and West, S. (1982) Validity of self-evaluation of ability: A review and meta-analysis. Applied Psychology: An International Review, 67, pp. 280-296.
50. Martocchio, J. and Judge, T. (1997) Relationship between conscientiousness and learning in employee training: Mediating influences of self-deception and self-efficacy. Journal of Applied Psychology, 82:5, pp. 764-773.
51. Maurer, T. and Tarulli, B. (1996) Acceptance of peer/upward performance appraisal systems: Role of work context factors and beliefs about managers' development capability. Human Resource Management, 35:2, pp. 217-241.
52. Maxim, BR and Dielman, TE (1987) Dimensionality, internal consistency and interrrater reliability of clinical performance ratings. Medical Education, 21, pp. 130-137.
53. McCarthy, A. and Garavan, T. (1999) Developing self-awareness in the managerial career development process: The value of 360° feedback and the MBTI. Journal of European Industrial Training, 23:9, pp. 437-445.
54. McCarthy, AM and Garavan, TN (2001) 360 Degree feedback processes: performance improvement and employee career development. Journal of European Industrial Training, 25:1, pp. 3-32.
55. McEvoy, G. and Buller, P. (1987) User acceptance of peer appraisals in an industrial setting. Personnel Psychology, 40, pp. 785-797.
56. Murphy, K. and Cleveland, J. (1991) Performance Appraisal: An Organizational Perspective, Allyn & Bacon, Boston, MA
57. Newble, D., Paget, N. and McLaren, B. (1999) Revalidation in Australia and New Zealand: Approach of Royal Australasian College of Physicians. British Medical Journal, 319:7218, pp. 1185-1188.
58. O'Reilly, B. (1994) 360° feedback can change your life. Fortune, 130:8, pp. 93-97.
59. Payne, T. (1998) Editorial: 360 degree assessment and feedback. International Journal of Selection and Assessment, 6:1, pp. 16-18.
60. Penny, JA (2003) Exploring differential item functioning in a 360-degree assessment: Rater source and method of delivery. Organisational Research Methods, 6:1, pp. 61-79.
61. Ramsey, PG, Carline, JD, Blank, LL and Wenrich, MD (1996) Feasibility of hospital-based use of peer ratings to evaluate the performances of practicing physicians. Academic Medicine, 71:4, pp. 364-370.
62. Ramsey, PG, Wenrich, MD, Carline, JD, Inui, TS, Larson, B. and LoGerfo, JP (1993) Use of peer ratings to evaluate physician performance. Journal of the American Medical Association, 269, pp. 1655-1660.
63. Riggio, R. and Cole, E. (1992) Agreement between subordinate and superior ratings of supervisory performance and effects on self and subordinate job satisfaction. Journal of Occupational and Organizational Psychology, 65, pp. 151-158.
64. Risucci, DA, Tortolania, AJ and Ward, RJ (1989) Ratings of surgical residents by Self supervisors and peers. Surgery, Gynaecology + Obstetrics, 169, pp. 519-526.
65. Saavedra, R. and Kwun, S. (1993) Peer evaluation in self-managing work groups. Journal of Applied Psychology, 78:3, pp. 450-462.
66. Southgate, L., Hays, RB, Norcini, J., Mulholland, H., Ayers, B., Woolliscroft, J., Cusimano, M., McAvoy, P., Ainsworth, M., Haist, S. and Campbell, M. (2001) Setting performance standards for medical practice: a theoretical framework. Medical Education, 35:5, pp. 474-481.
67. Steensma, C., Gould, L. and Moseley, C. (1998) Using a group-based 360 degree feedback process to facilitate the merger of four marketing units at Disney Networks. US Human Resource Planning, 2:4, pp. 11-15.
68. Tornow, W. (1993) Perceptions or reality: Is multi-perspective measurement a means to an end?. Human Resource Management, 32:23, pp. 221-229.
69. Tornow, W. and London, M. (1998) Maximizing the Value of 360-degree Feedback: A Process for Successful Individual and Organizational Development, Jossey-Bass, San Francisco, CA
70. Towers-Perrin (1998) 360° Feedback: The Global Perspective, Towers Perrin, London
71. Van der Heijden, BI and Nijhof, AH (2004) The value of subjectivity: problems and prospects for 360 degree appraisal systems. International Journal of Resource Management, 15:3, pp. 493-511.
72. Waldman, D. (1997) Predictors of employee preferences for multi-rater and group-based performance appraisal. Group and Organization Management, 22:2, pp. 264-287.
73. Waldman, D. and Bowen, D. (1998) The acceptability of 360° appraisals: A customer-supplier relationship perspective. Human Resource Management, 37:2, pp. 117-129.
74. Wenrich, MD, Carline, JD, Giles, LM and Ramsay, P. (1993) Ratings of the performances of practising internists by hospital based registered nurses. Academic Medicine, 68, pp. 680-687.
75. Whitehouse, A., Hassell, A., Wood, L., Wall, D., Walzman, M. and Campbell, I. (2005) Development and reliability testing of a new form for 360 degree assessment of senior house officers' professional behaviour, as specified by the General Medical Council. Medical Teacher, 27, pp. 252-258.
76. Whitehouse, A., Wall, D. and Walzman, M. (2002) Pilot study of 360 degree assessment of personal skills of senior house officers. Hospital Medicine, 63:3, pp. 172-175.
77. Wimer, S. and Nowack, K. (1998) Thirteen common mistakes using 360-degree feedback. Training and Development, 52:5, pp. 69-79.
78. Wood, L. and Campbell, I. (2004) 360 degree assessment: Encouraging results of a 6 year study. Annual Meeting of the Association for the Study of Medical Education, Liverpool, UK
79. Woolliscroft, JO, Howell, JD, Patel, BP and Swanson, DB (1994) Resident-patient interactions: The humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors, and nurses. Academic Medicine, 69:3, pp. 216-224.
80. Yukl, G. and Lepsinger, R. (1995) How to get the most out of 360° feedback. Training and Development, 32:12, pp. 45-50.
81. Zhang, Z., Luk, W., Arthur, D. and Wong, T. (2001) Nursing competencies: personal characteristics contributing to effective nursing performance. Advances in Nursing, 33:4, pp. 467-474.