Development of a theory-based assessment of team member effectiveness

Educational and Psychological Measurement

Volumn 67, Issue 3, 2007, Pages 505-524

  Loughry, Misty L ^a   Ohland, Matthew W ^b   Dewayne Moore, D ^c  

^a GEORGIA SOUTHERN UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

^c CLEMSON UNIVERSITY   (United States)

Author keywords

Measure; Peer evaluation; Self evaluation; Team member effectiveness; Teams

Indexed keywords

EID: 34248164995     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164406292085     Document Type: Article

References (55)

1. ABET Engineering Accreditation Commission. (2004). Criteria for accrediting engineering programs. Retrieved December 14, 2004, from http://www.abet.org/images/Criteria/E001%2005-06%20EAC%20Criteria%2011-17-04.pdf
2. Anderson, N.R., West, M.A. (1998). Measuring climate for work group innovation: Development and validation of the team climate inventory. Journal of Organizational Behavior, 19, 235-258.
3. Baldwin, T.T., Bedell, M.D., Johnson, J.L. (1997). The social fabric of a team-based M.B.A. program: Network effects on student satisfaction and performance. Academy of Management Journal, 40, 1369-1397.
4. Barrick, M.R., Mount, M.K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
5. BESTEAMS. (n.d.). Retrieved July 15, 2004, from the University of Maryland Web site: http://www.enme.umd.edu/labs/BESTEAMS/index.html
6. Bettenhausen, K.L., Fedor, D.B. (1997). Peer and upward appraisals: A comparison of their benefits and problems. Group Organization Management, 22, 236-263.
7. Borman, W.C., White, L.A., Dorsey, D.W. (1995). Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings. Journal of Applied Psychology, 80, 168-177.
8. Campion, M.A., Medsker, G.J., Higgs, A.C. (1993). Relations between work group characteristics and effectiveness: Implications for designing effective work groups. Personnel Psychology, 46, 823-850.
9. Cannon-Bowers, J.A., Tannenbaum, S.I., Salas, E., Volpe, C.E. (1995). Defining competencies and establishing team training requirements. In R. A. Guzzo E. Salas (Eds.), Team effectiveness and decision making in organizations (pp. 333-380). San Francisco: Jossey-Bass.
10. Carpenter, M.A. (2002). The implications of strategy and social context for the relationship between top management team heterogeneity and firm performance. Strategic Management Journal, 23, 275-284.
11. Commission on Accreditation for Dietetics Education. (2002). 2002 eligibility requirements and accreditation standards. Retrieved December 14, 2004, from http://www.eatright.org/Public/Files/2002_ERAS-Web.pd f
12. Conway, J.M., Huffcutt, A.I. (1997). Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisory, peer, and self-ratings. Human Performance, 10, 331-360.
13. Cordes, D., Parker, J.K., Hopenwasser, A., Laurie, C., Izatt, J.R., Nikles, D. (1995). Teaming in technical courses. In Proceedings of the Frontiers in Education Conference. Retrieved January 5, 2005, from http://fie.engrng. pitt.edu/fie95/4c3/4c34/4c34.htm
14. Erez, A., LePine, J.A., Elms, H. (2002). Effects of rotated leadership and peer evaluation on the functioning and effectiveness of self-managed teams: A quasi-experiment. Personnel Psychology, 55, 929-948.
15. Guzzo, R.A., Yost, P.R., Campbell, R.J., Shea, G.P. (1993). Potency in groups: Articulating a construct. British Journal of Social Psychology, 32, 87-106.
16. Harris, M.M., Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41, 43-62.
17. Harris, T.C., Barnes-Farrell, J.L. (1997). Components of teamwork: Impact on evaluations of contributions to work team effectiveness. Journal of Applied Social Psychology, 27, 1694-1715.
18. Hayton, J.C., Allen, D.G., Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191-205.
19. Hedge, J.W., Bruskiewicz, K.T., Logan, K.K., Hanson, M.A., Buck, D. (1999). Crew resource management team and individual job analysis and rating scale development for air force tanker crews (Technical Rep. No. 336). Minneapolis, MN: Personnel Decisions Research Institutes.
20. Henson, R.K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
21. Hoegl, M., Gemuenden, H.G. (2001). Teamwork quality and the success of innovative projects: A theoretical concept and empirical evidence. Organization Science, 12, 435-449.
22. Hu, L., Bentler, P.M. (1999). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
23. Hyatt, D.E., Ruddy, T.M. (1997). An examination of the relationship between work group characteristics and performance: Once more into the breech. Personnel Psychology, 50, 553-585.
24. Jordan, M.H., Field, H.S., Armenakis, A.A. (2002). The relationship of group process variables and team performanceA team-level analysis in a field setting. Small Group Research, 33, 121-150.
25. Latane, B., Williams, K., Harkins, S. (1979). Many hands make light the work: The causes and consequences of social loafing. Journal of Personality and Social Psychology, 37, 822-832.
26. Lawler, E.E., Mohrman, S.A., Benson, G. (2001). Organizing for high performance: Employee involvement, TQM, reengineering, and knowledge management in the Fortune 1000. San Francisco: Jossey-Bass.
27. LePine J.A. (2003). Team adaptation and postchange performance: Effects of team composition in terms of members' cognitive ability and personality. Journal of Applied Psychology, 88, 27-39.
28. Little, T.D., Lindenberger, U., Nesselrode, J.R. (1999). On selecting indicators for multivariate measurement and modeling with latent variables: When good indicators are bad and bad indicators are good. Psychological Methods, 4, 192-211.
29. London, M., Smither, J.W., Adsit, D.J. (1997). Accountability: The Achilles' heel of multisource feedback. Group Organization Management, 22, 162-184.
30. Marks, M.A., Burke, C.S., Sabella, M.J., Zaccaro, S.J. (2002). The impact of cross-training on team effectiveness. Journal of Applied Psychology, 87, 3-13.
31. Marsh, H., Hau, K., Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings, Structural Equation Modeling, 11, 320-341.
32. McAllister, D.J. (1995). Affect-and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal, 38, 24-59.
33. McGourty, J., De Meuse, K.P. (2001). The team developer: An assessment and skill building program. Student guidebook. New York: John Wiley.
34. McIntyre, R.M., Salas, E. (1995). Measuring and managing for team performance: Emerging principles from complex environments. In R. A. Guzzo E. Salas (Eds.), Team effectiveness and decision making in organizations (pp. 9-45). San Francisco: Jossey-Bass.
35. Mohammed, S., Angell, L.C. (2003). Personality heterogeneity in teams: Which differences make a difference for team performance? Small Group Research, 34, 651-677.
36. Moran, L., Musselwhite, E., Zenger, J.H. (1996). Keeping teams on track: What to do when the going gets rough. Chicago: Irwin Professional Publishing.
37. Neuman, G.A., Wright, J. (1999). Team effectiveness: Beyond skills and cognitive ability. Journal of Applied Psychology, 84, 376-389.
38. Niehoff, B.P., Moorman, R.H. (1993). Justice as a mediator of the relationship between methods of monitoring and organizational citizenship behavior. Academy of Management Journal, 36, 527-556.
39. Nunnally, J.C., Bernstein, I.H. (1994). Psychometric theory (3 rd ed). New York: McGraw-Hill.
40. O'Connor, B.P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavioral Research Methods, Instrumentation, and Computers, 32, 396-402.
41. Rosenstein, R., Dickinson, T.L. (1996, August). The teamwork components model: An analysis using structural equation modeling. In R. M. McIntyre (Chair). Advances in definitional team research. Symposium conducted at the annual meeting of the American Psychological Association, Toronto, Canada.
42. Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350-353.
43. Schmitt, N., Gooding, R.Z., Noe, R.A., Kirsch, M. (1984). Metaanalyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407-422.
44. Schwarzwald, J., Koslowsky, M., Mager-Bibi, T. (1999). Peer ratings versus peer nominations during training as predictors of actual performance criteria. Journal of Applied Behavioral Science, 35, 360-372.
45. Sheppard, S., Chen, H.L., Schaeffer, E., Steinbeck, R., Neumann, H., Ko, P. (2004). Peer assessment of student collaborative processes in undergraduate engineering education (Final Report to the National Science Foundation, Award Number 0206820, NSF Program 7431 CCLI-ASA). Washington, DC: National Science Foundation.
46. Shore, T.H., Shore, L.M., Thornton, G.C., III. (1992). Construct validity of self-and peer evaluations of performance dimensions in an assessment center. Journal of Applied Psychology, 77, 42-54.
47. Spich, R.S., Keleman, K. (1985). Explicit norm structuring process: A strategy for increasing task-group effectiveness. Group Organization Studies, 10, 37-59.
48. Stevens, M.J., Campion, M.A. (1994). The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management, 20, 503-530.
49. Stevens, M.J., Campion, M.A. (1999). Staffing work teams: Development and validation of a selection test for teamwork settings. Journal of Management, 25, 207-228.
50. Taggar, S., Brown, T.C. (2001). Problem-solving team behaviors: Development and validation of BOS and a hierarchical factor structure. Small Group Research, 32, 698-726.
51. Van Duzer, E., McMartin, F. (2000) Methods to improve the validity and sensitivity of a self/peer assessment instrument. IEEE Transactions on Education, 43, 153-158.
52. Viswesvaran, C., Ones, D.S., Schmidt, F.L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-574.
53. Viswesvaran, C., Schmidt, F.L., Ones, D.S. (2005). Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90, 108-131.
54. Weldon, E., Jehn, K.A., Pradhan, P. (1991). Processes that mediate the relationship between a group goal and improved group performance. Journal of Personality and Social Psychology, 61, 555-569.
55. Wheelan, S.A. (1999). Creating effective teams: A guide for members and leaders. Thousand Oaks, CA: Sage.