The longitudinal effects of peer feedback in the development and transfer of student teamwork skills

Learning and Individual Differences

Volumn 61, Issue , 2018, Pages 87-98

  Donia, Magda B L ^a   O'Neill, Thomas A ^b   Brutus, Stéphane ^c  

^a UNIVERSITY OF OTTAWA   (Canada)

^b UNIVERSITY OF CALGARY   (Canada)

^c Dept of Electrical and Computer Engineering   (Canada)

Author keywords

Confidence providing feedback; Organizational citizenship behaviors; Peer feedback system; Teamwork performance

Indexed keywords

EID: 85034779787     PISSN: 10416080     EISSN: 18733425     Source Type: Journal    
DOI: 10.1016/j.lindif.2017.11.012     Document Type: Article

References (69)

1. AACSB, Management education at risk: Report of the Management Education Task Force to the AACSB. (Retrieved from) http://www.aacsb.edu/~/media/AACSB/Publications/research-reports/management-education-at-risk.ashx, 2002.
2. Allen, T.D., Rewarding good citizens: The relationship between citizenship behavior, gender, and organizational rewards. Journal of Applied Social Psychology 36 (2006), 120–143.
3. Andrews, J., Higson, H., Graduate employability, 'soft skills' versus 'hard' business knowledge: A European study. Higher Education in Europe 33 (2008), 411–422.
4. Anson, R., Goodman, J.A., A peer assessment system to improve student team experiences. Journal of Education for Business 89:1 (2014), 27–34, 10.1080/08832323.2012.754735.
5. Applebaum, E., Blatt, R., The new American Workplace. 1994, ILR, Ithaca, NY.
6. Bandura, A., Social cognitive theory of self-regulation. Organizational Behavior and Human Decision Processes 50:2 (1991), 248–287, 10.1016/0749-5978(91)90022-L.
7. Bateman, T.S., Organ, D.W., Job satisfaction and the good soldier: The relationship between affect and employee “citizenship.”. Academy of Management Journal 26:4 (1983), 587–595, 10.2307/255908.
8. Bernardin, H.J., Villanova, P., Research streams in rater self-efficacy. Group & Organization Management 30 (2005), 61–88.
9. Boning, B., Ichniowski, C., Shaw, K., Opportunity counts: Teams and the effectiveness of production incentives. Journal of Labor Economics 25:4 (2007), 613–650, 10.1086/519539.
10. Brooks, C.M., Ammons, J.L., Free riding in group projects and the effects of timing, frequency, and specificity of criteria in peer assessments. Journal of Education for Business 78 (2003), 268–272.
11. Brutus, S., Donia, M., Improving the effectiveness of students in groups with a centralized peer evaluation system. Academy of Management Learning & Education 9:4 (2010), 652–662 (Retrieved from) http://amle.aom.org/.
12. Brutus, S., Donia, M.B.L., Ronen, S., Can business students learn to evaluate better? Evidence from repeated exposure to a peer evaluation system. Academy of Management Learning & Education 12:1 (2013), 18–31, 10.5465/amle.2010.0204.
13. Bryk, A.S., Raudenbush, S.W., Hierarchical linear models: Applications and data analysis methods. 2002, Sage, Newbury Park, CA.
14. Butler, D.L., Winne, P.H., Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research 65:3 (1995), 245–281.
15. Carpenter, N.C., Berry, C.M., Houston, L., A meta-analytic comparison of self-reported and other-reported organizational citizenship behavior: Self-reported and other-reported organizational citizenship behavior. Journal of Organizational Behavior 35:4 (2014), 547–574, 10.1002/job.1909.
16. Carver, C.S., Scheier, M.F., Control theory: A useful conceptual framework for personality-social, clinical, and health psychology. Psychological Bulletin 92:1 (1982), 111–135, 10.1037/0033-2909.92.1.111.
17. Cohen, J., Statistical power analysis for the behavioral sciences. 2nd ed., 1988, Lawrence Erlbaum Associates, Hillsdale, NJ.
18. DeNisi, A.S., Kluger, A.N., Feedback effectiveness: Can 360-degree appraisals be improved?. The Academy of Management Executive 14:1 (2000), 129–139 (1993–2005). (Retrieved from) https://www.jstor.org/journal/acadmanaexec.
19. Dominick, P.G., Reilly, R.R., Mcgourty, J.W., The effects of peer feedback on team member behavior. Group & Organization Management 22:4 (1997), 508–520, 10.1177/1059601197224006.
20. Drexler, J.A., Beehr, T.A., Stetz, T.A., Peer appraisals: Differentiation of individual performance on group tasks. Human Resource Management, 40(4), 2001, 333.
21. Druskat, V.U., Wolff, S.B., Effects and timing of developmental peer appraisals in self-managing work groups. Journal of Applied Psychology 84:1 (1999), 58–74, 10.1037/0021-9010.84.1.58.
22. Eddy, E.R., Tannenbaum, S.I., Mathieu, J.E., Helping teams to help themselves: Comparing two team-led debriefing methods. Personnel Psychology 66:4 (2013), 975–1008, 10.1111/peps.12041.
23. Erez, A., LePine, J.A., Elms, H., Effects of rotated leadership and peer evaluation on the functioning and effectiveness of self-managed teams: A quasi-experiment. Personnel Psychology 55:4 (2002), 929–948, 10.1111/j.1744-6570.2002.tb00135.x.
24. Fyfe, E.R., Rittle-Johnson, B., Feedback both helps and hinders learning: The causal role of prior knowledge. Journal of Educational Psychology 108:101 (2016), 82–97, 10.1037/edu0000053.
25. Fyfe, E.R., Rittle-Johnson, B., DeCaro, M.S., The effects of feedback during exploratory mathematics problem solving: Prior knowledge matters. Journal of Educational Psychology 104:4 (2012), 1094–1108, 10.1037/a0028389.
26. Gabelica, C., Van den Bossche, P., Segers, M., Gijselaers, W., Feedback, a powerful lever in teams: A review. Educational Research Review 7 (2012), 123–144.
27. Gardner, J., Scogin, F., Vipperman, R., Varela, J.G., The predictive validity of peer assessment in law enforcement: A 6 year follow-up. Behavioral Sciences & the Law 16:4 (1998), 473–478, 10.1002/(SICI)1099-0798(199823)16:4<473::AID-BSL322>3.0.CO;2-H.
28. Greenberg, A.D., Nilssen, A.H., The role of education in building soft skills: Putting into perspective the priorities and opportunities for teaching collaboration and other soft skills in education. 2015, Wainhouse Research (Retrieved from https://www.google.ca/url?sa = t&rct = j&q =&esrc = s&source = web&cd = 1&ved = 0ahUKEwiTnt7f4KHQAhUh6YMKHQIhAw0QFggdMAA&url = https%3A%2F%2Feducation.smarttech.com%2F ~%2Fmedia%2Ffiles%2Fwhitepapers%2Fwainhouse%2520research%2520whitepaper%2520%2520soft%2520skills%2520in%2520education%2520v2.ashx&usg = AFQjCNE1HE-yNuEmHtKmiDzG0_ig-nd0pg&sig2 = Ikglp0MKGj2OSpE5JDih5g&cad = rja).
29. Guzzo, R.A., Dickson, M.W., Teams in organizations: Recent research on performance and effectiveness. Annual Review of Psychology 47 (1996), 307–338.
30. Hart Research Associates. 2015 “Falling short? College learning and career success: Selected findings from online surveys of employers and college students conducted on behalf of the Association of American Colleges & Universities”. (Retrieved from http://www.aacu.org/sites/default/files/files/LEAP/2015employerstudentsurvey.pdf).
31. Hattie, J., Timperley, H., The power of feedback. Review of Educational Research 77:1 (2007), 81–112.
32. Hinkin, T.R., A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods 1:1 (1998), 104–121.
33. Hinkin, T.R., Tracey, J.B., Enz, C.A., Scale construction: Developing reliable and valid measurement instruments. Journal of Hospitality and Tourism Research 21:1 (1997), 100–120.
34. Hoffman, B.J., Blair, C.A., Meriac, J.P., Woehr, D.J., Expanding the criterion domain? A quantitative review of the OCB literature. Journal of Applied Psychology 91 (2007), 555–566.
35. Hofmann, D.A., Issues in multilevel research: Theory development, measurement, and analysis. Rogelberg, S.G., (eds.) Handbook of research methods in industrial and organizational psychology, 2004, Blackwell, Malden, MA, 247–274.
36. Hughes, R.L., Jones, S.K., Developing and assessing college student teamwork skills. New directions for institutional research, Vol. 149, 2011, 53–64 (Retrieved from) http://onlinelibrary.wiley.com/doi/10.1002/ir.380/epdf.
37. Jawahar, I.M., Williams, C.R., Where all the children are above average: The performance appraisal purpose effect. Personnel Psychology 50 (1997), 905–925, 10.1111/j.1744-6570.1997.tb01487.x.
38. Keller, S., Kruyt, M., Malan, J., How do I develop an effective top team?. 2010, McKinsey&Company Retrieved from http://mld.mckinsey.com/downloads/centers/How_do_I_develop_an_effective_top_team.pdf.
39. Kluger, A.N., DeNisi, A., The effects of feedback interventions on performance: A historical review, a meta-analysis and a preliminary feedback intervention theory. Psychological Bulletin 119 (1996), 254–284.
40. Kluger, A.N., DeNisi, A., Feedback interventions: Toward the understanding of a double-edged sword. Current Directions in Psychological Science 7:3 (1998), 67–72.
41. LeBreton, J.M., Scherer, K.T., James, L.R., Corrections for criterion reliability in validity generalization: A false prophet in a land of suspended judgment. Industrial and Organizational Psychology 7:4 (2014), 478–500, 10.1111/iops.12184.
42. Livingstone, L., Dean's corner: Faculty development at the heart of technology enabled and experiential learning. (Retrieved from) http://enewsline.aacsb.edu/deanscorner/livingstone.asp, 2013.
43. Loughry, M.L., Ohland, M.W., Woehr, D.J., Assessing teamwork skills for assurance of learning using CATME team tools. Journal of Marketing Education 36 (2014), 5–19.
44. Marinova, S.V., Moon, H., Van Dyne, L., Are all good soldier behaviors the same? Supporting multidimensionality of organizational citizenship behaviors based on rewards and roles. Human Relations 63:10 (2010), 1463–1485, 10.1177/0018726709359432.
45. Navarro, P., The MBA core curricula of top-ranked U.S. business schools: A study in failure?. The Academy of Management Learning and Education 7:1 (2008), 108–123, 10.5465/AMLE.2008.31413868.
46. Navarro, P., Business schools: A study in failure. (Retrieved from) http://www.bloomberg.com/news/articles/2008-04-22/business-schools-a-study-in-failurebusinessweek-business-news-stock-market-and-financial-advice, 2008, April 23.
47. O'Neill, T.A., Deacon, A., Larson, N.L., Hoffart, G.C., Brennan, R.W., Eggermont, M., Rosehart, W., Life-long learning, conscientious disposition, and longitudinal measures of academic engagement in engineering design teamwork. Learning and Individual Differences 39 (2015), 124–131, 10.1016/j.lindif.2015.03.022.
48. O'Neill, T.A., Goffin, R.D., Gellatly, I.R., The knowledge, skill, and ability requirements for teamwork: Revisiting the teamwork-KSA test's validity. International Journal of Selection and Assessment 20:1 (2012), 36–52, 10.1111/j.1468-2389.2012.00578.x.
49. O'Neill, T.A., Hoffart, G.C., McLarnon, M.J.W., Woodley, H.J., Eggermont, M., Rosehart, W., Brennan, R., Constructive controversy and reflexivity training promotes effective conflict profiles and outcomes in student learning teams. The Academy of Management Learning and Education 16 (2017), 257–276.
50. O'Neill, T.A., McLarnon, M.J.W., Carswell, J.J., Variance components of job performance ratings. Human Performance 28:1 (2015), 66–91, 10.1080/08959285.2014.974756.
51. O'Neill, T.A., McLarnon, M.J.W., Schneider, T.J., Gardner, R.C., Current misuses of multiple regression for investigating bivariate hypotheses: An example from the organizational domain. Behavior Research Methods 46:3 (2014), 798–807, 10.3758/s13428-013-0407-1.
52. Podsakoff, N.P., Whiting, S.W., Podsakoff, P.M., Blume, B.D., Individual- and organizational-level consequences of organizational citizenship behaviors: A meta-analysis. Journal of Applied Psychology 94:1 (2009), 122–141, 10.1037/a0013079.
53. Preacher, K.J., Curran, P.J., Bauer, D.J., Computational tools for probing interactions in multiple linear regression, multilevel modeling, and latent curve analysis. Journal of Educational and Behavioral Statistics 31:4 (2006), 437–448.
54. Reilly, R.R., Smither, J.W., Vasilopoulos, N.L., A longitudinal study of upward feedback. Personnel Psychology 49:3 (1996), 599–612, 10.1111/j.1744-6570.1996.tb01586.x.
55. Rittle-Johnson, B., Star, J.R., Durkin, K., The importance of prior knowledge when comparing examples: Influences on conceptual and procedural knowledge of equation solving. Journal of Educational Psychology 101:104 (2009), 836–852, 10.1037/a0016026.
56. Robbles, M.M., Executive perceptions of the top 10 soft skills needed in today's workplace. Business Communication Quarterly 75 (2012), 453–465.
57. Saavedra, R., Kwun, S.K., Peer evaluation in self-managing workgroups. Journal of Applied Psychology 78:3 (1993), 450–462.
58. Salas, E., Shuffler, M.L., Thayer, A.L., Bedwell, W.L., Lazzara, E.H., Understanding and improving teamwork in organizations: A scientifically based practical guide. Human Resource Management 54:4 (2015), 599–622, 10.1002/hrm.21628.
59. Singer, J.D., Willett, J.B., Applied longitudinal data analysis: Modeling change and event occurrence. 2003, Oxford University Press, Oxford.
60. Smither, J.W., London, M., Reilly, R.R., Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology 58:1 (2005), 33–66, 10.1111/j.1744-6570.2005.514_1.x.
61. Tannenbaum, S.I., Beard, R.L., Cerasoli, C.P., Conducting team debriefs that work: Lessons from research and practice. Salas, E., Tannenbaum, S.I., Cohen, D., Latham, G.G., (eds.) Developing and enhancing high–performance teams: Evidence-based practices and advice, 2013, Jossey-Bass, San Francisco, CA, 488–519.
62. van Schaik, S., Regehr, G., Eva, K., Irby, D.M., O'Sullivan, P., Perceptions of peer-to-peer Interprofessional feedback among students in the health professions. Academic Medicine 91 (2016), 807–812.
63. Villanova, P., Bernardin, H.J., Dahmus, S.A., Sims, R.L., Rater leniency and performance appraisal discomfort. Educational and Psychological Measurement 53 (1993), 789–799.
64. Viswesvaran, C., Ones, D.S., Schmidt, F.L., Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology 81:5 (1996), 557–574, 10.1037//0021-9010.81.5.557.
65. Waddock, S., Lozano, J.M., Developing more holistic management education: Lessons learned from two programs. The Academy of Management Learning and Education 12:2 (2013), 265–284, 10.5465/amle.2012.0002.
66. Walker, A.G., Smither, J.W., A five-year study of upward feedback: What managers do with their results matters. Personnel Psychology 52:2 (1999), 393–423, 10.1111/j.1744-6570.1999.tb00166.x.
67. West, B.T., Welch, K.B., Galecki, A.T., Linear mixed models: A practical guide to statistical software. 2nd ed., 2007, Chapman & Hall/CRC, New York.
68. Williams, L.J., Anderson, S.E., Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management 17 (1991), 601–617.
69. Zedeck, S., Goldstein, I.L., The relationship between I/O psychology and public policy: A commentary. Kehoe, J.F., (eds.) Managing selection in changing organizations: Human resource strategies, 2000, Jossey-Bass, San Francisco, CA, 371–396.