A longitudinal examination of the comparative criterion-related validity of additive and referent-shift consensus operationalizations of team efficacy

Organizational Research Methods

Volumn 10, Issue 1, 2007, Pages 35-58

  Arthur Jr , Winfred ^a   Bell, Suzanne T ^b   Edwards, Bryan D ^c  

^a TEXAS A AND M UNIVERSITY   (United States)

^b DEPAUL UNIVERSITY   (United States)

^c TULANE UNIVERSITY   (United States)

Author keywords

Collective efficacy; Models; Multilevel issues; Team efficacy; Team performance; Teams

Indexed keywords

EID: 33845678168     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428106287574     Document Type: Article

References (67)

1. Ackerman, P. L., Kanfer, R., & Goff, M. (1995). Cognitive and noncognitive determinants and consequences of complex skill acquisition. Journal of Experimental Psychology: Applied, 1, 270-304.
2. Ajzen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice Hall.
3. Ancona, D. G., Goodman, P. S., Lawrence, B. S., & Tushman, M. L. (2001). Time: A new research lens. Academy of Management Review, 26, 645-663.
4. Arthur, W., Jr., Bennett, W., Jr., Tubre, T. C., Sanchez-Ku, M. L., Sheehan, K., Paul, D. S., et al. (1999). Selection into performance teams: A laboratory investigation of g-based optimal pairing strategies in a dyadic team training protocol. AL/HRTD contract F416224-95-C-5007. San Antonio, TX: Galaxy Scientific.
5. Arthur, W., Jr., Day, E. A., Bennett, W., Jr., McNelly, T. L., & Jordan, J. A. (1997). Dyadic versus individual training protocols: Loss and reacquisition of a complex skill. Journal of Applied Psychology, 82, 783-791.
6. Arthur, W., Jr., Edwards, B. D., Bell, S. T., Villado, A. J., & Bennett, W., Jr. (2005). Team task analysis: Identifying tasks and jobs that are team-based. Human Factors, 47, 654-669.
7. Arthur, W., Jr., Villado, A. J., & Bennett W. Jr. (in press). Innovations in team task analysis: Identifying task elements, tasks, and jobs that are team-based. In W. Bennett Jr. (Ed.), The future of job analysis. Mahwah, NJ: Lawrence Erlbaum.
8. Baker, D. F. (2001). The development of collective efficacy in small task groups. Small Group Research, 32, 451-474.
9. Baker, D. P., & Salas, E. (1997). Principles for measuring teamwork: A summary and look toward the future. In M. T. Brannick, E. Salas, & C. Prince (Eds.), Team performance, assessment, and measurement: Theory, methods, and applications (pp. 331-355). Mahwah, NJ: Lawrence Erlbaum.
10. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
11. Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
12. Bandura, A. (2000). Exercise of human agency through collective efficacy. Current Directions in Psychological Science, 9, 75-78.
13. Bartko, J. J. (1976). On various intraclass correlation reliability coefficients. Psychological Bulletin, 83, 762-765.
14. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.
15. Castro, S. L. (2002). Data analytic methods for the analysis of multilevel questions: A comparison of intraclass correlation coefficients, rwg(j), hierarchical linear modeling, within and between-analysis, and random group resampling analysis. Leadership Quarterly, 13, 69-93.
16. Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
17. Chen, G., & Bliese, P. D. (2002). The role of different levels of leadership in predicting self-and collective-efficacy: Evidence for discontinuity. Journal of Applied Psychology, 87, 549-556.
18. Chen, G., Mathieu, J. E., & Bliese, P. D. (2004). A framework for conducting multi-level construct validation. In F. J. Yammarino & F. Dansereau (Eds.), Research in multi-level issues: Multilevel issues in organizational behavior and processes (Vol. 3, pp. 273-303). Oxford, UK: Elsevier.
19. Chen, G., Webber, S. S., Bliese, P. D., Mathieu, J. E., Payne, S. C., Born, D. H., et al. (2002). Simultaneous examination of the antecedents and consequences of efficacy beliefs at multiple levels of analysis. Human Performance, 15, 381-409.
20. Day, E. A., Arthur, W., Jr., Bell, S. T., Edwards, B. D., Bennett, W., Jr., Mendoza, J. L., et al. (2005). Abilitybased pairing strategies in the team-based training of a complex skill: Does the intelligence of your training partner matter? Intelligence, 33, 39-65.
21. Day, E. A., Arthur, W., Jr., & Gettman, D. (2001). Knowledge structures and the acquisition of a complex skill. Journal of Applied Psychology, 86, 1022-1033.
22. Donchin, E. (1989). The learning strategies project: Introductory remarks. Acta Psychologica, 71, 1-15.
23. Feltz, D. L., & Lirgg, C. D. (1998). Perceived team and player efficacy in hockey. Journal of Applied Psychology, 83, 557-564.
24. Frederiksen, J. R., & White, B. Y. (1989). An approach to training based on principled task decomposition. Acta Psychologica, 71, 89-146.
25. George, J. M., & Jones, G. R. (2000). The role of time in theory and theory building. Journal of Management, 26, 657-684.
26. Gibson, C. B., Randel, A. E., & Earley, P. C. (2000). Understanding group efficacy: An empirical test of multiple assessment methods. Group and Organization Management, 25, 67-97.
27. Gist, M. E. (1987). Self-efficacy: Implications for organizational behavior and human resource management. Academy of Management Review, 12, 472-485.
28. Gladstein, D. L. (1984). Groups in context: A model of task group effectiveness. Administrative Science Quarterly, 29, 499-517.
29. Gopher, D. (1993). The skill of attention control: Acquisition and execution of attention strategies. In D. Meyer & S. Korenblom (Eds.), Attention and performance XIV: Synergies in experimental psychology, artificial intelligence, and cognitive neuroscience (pp. 299-322). Hillsdale, NJ: Lawrence Erlbaum.
30. Gopher, D., Weil, M., & Bareket, T. (1994). The transfer of skill from a computer game trainer to actual flight. Human Factors, 36, 387-405.
31. Gopher, D., Weil, M., & Siegel, D. (1989). Practice under changing priorities: An approach to the training of complex skills. Acta Psychologica, 71, 147-177.
32. Gully, S. M., Incalcaterra, K. A., Joshi, A., & Beaubien, J. M. (2002). A meta-analysis of team efficacy, potency, and performance: Interdependence and level of analysis as moderators of observed relationships. Journal of Applied Psychology, 87, 819-832.
33. Guzzo, R. A., Yost, P. R., Campbell, R. J., & Shea, G. P. (1993). Potency in groups: Articulating a construct. British Journal of Social Psychology, 32, 87-106.
34. Hackman, J. R. (1987). The design of work teams. In J. Lorsch (Ed.), Handbook of organizational behavior (pp. 315-342). Englewood Cliffs, NJ: Prentice Hall.
35. Hart, S. G., & Battiste, V. (1992). Field test of a video game trainer. In Proceedings of the Human Factors and Ergonomics Society 36th Annual Meeting (pp. 1291-1295). Santa Monica, CA: Human Factors and Ergonomics Society.
36. Heggestad, E. D., & Kanfer, R. (2005). The predictive validity of self-efficacy in training performance: Little more than past performance. Journal of Experimental Psychology: Applied, 11, 84-97.
37. Henry, R. A., & Hulin, C. L. (1987). Stability of skilled performance across time: Some generalizations and limitations on utilities. Journal of Applied Psychology, 72, 457-462.
38. James, L. R., Demaree, R. G., & Wolf, G. (1993). rwg: An assessment of within group interrater agreement. Journal of Applied Psychology, 78, 306-339.
39. Judge, T. A., Jackson, C. L., Shaw, J. C., Scott, B., & Rich, B. L. (in press). Self-efficacy and work-related performance: The integral role of individual differences. Journal of Applied Psychology.
40. Jung, D. I., & Sosik, J. J. (2003). Group potency and collective efficacy: Examining their predictive validity, level of analysis, and effects of performance feedback on future group performance. Group and Organization Management, 28, 366-391.
41. Katz-Navon, T. Y., & Erez, M. (2005). When collective-and self-efficacy affect team performance: The role of task interdependence. Small Group Research, 36, 437-465.
42. Kirkman, B. L., Tesluk, P. E., & Rosen, B. (2001). Assessing the incremental validity of team consensus ratings over aggregation of individual-level data in predicting team effectiveness. Personnel Psychology, 54, 645-667.
43. Klein, K. J., Conn, A. B., Smith, B., & Sorra, J. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86, 3-16.
44. Kozlowski, S. W. J., Gully, S. M., Brown, K. G., Salas, E., Smith, E. M., & Nason, E. R. (2001). Effects of training goals and goal orientation traits on multidimensional training outcomes and performance adaptability. Organizational Behavior and Human Decision Processes, 85, 1-31.
45. Kozlowski, S. W. J., Gully, S. M., Nason, E. R., & Smith, E. M. (1999). Developing adaptive teams:A theory of compilation and performance across levels and time. In D. R. Ilgen & E. D. Pulakos (Eds.), The changing nature of performance: Implications for staffing, motivation, and development (pp. 240-292). San Francisco: Jossey-Bass.
46. Kozlowski, S. W. J., & Klein, K. J. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3-90). San Francisco: Jossey-Bass.
47. Kristof, A. L. (1996). Person-organization fit: An integrative review of its conceptualizations, measurement, and implications. Personnel Psychology, 49, 1-49.
48. Lewen, L. J., & Maurer, T. J. (2002, April). A comparison of single-item and traditional measures of self-efficacy. Paper presented at the 17th Annual Conference of the Society for Industrial and Organizational Psychology, Toronto, Canada.
49. Lindsley, D. H., Brass, D. J., & Thomas, J. B. (1995). Efficacy-performance spirals: A multilevel perspective. Academy of Management Review, 20, 645-678.
50. Littlepage, G. E., & Silbiger, H. (1992). Recognition of expertise in decision-making groups: Effects of group size and participation patterns. Small Group Research, 23, 344-355.
51. Mane, A. M., & Donchin, E. (1989). The Space Fortress game. Acta Psychologica, 71, 17-22.
52. Mischel, L. J., & Northcraft, G. B. (1997). "I think we can, I think we can...":The role of efficacy beliefs in group and team effectiveness. Advances in Group Processes, 14, 177-197.
53. Mitchell, T. R., & James, L. R. (2001). Building better theory: Time and the specification of when things happen. Academy of Management Review, 26, 530-547.
54. Morgeson, F. P., & Hofmann, D. A. (1999). The structure and function of collective constructs: Implications for multilevel research and theory development. Academy of Management Review, 24, 249-265.
55. Myers, N. D., Payment, C. A., & Feltz, D. L. (2004). Reciprocal relationships between collective efficacy and team performance in women's ice hockey. Group Dynamics, 8, 182-195.
56. Nagy, M. S. (2002). Using a single-item approach to measure facet job satisfaction. Journal of Occupational and Organizational Psychology, 75, 77-86.
57. Paskevich, D. M., Brawley, L. R., Dorsch, K. D., & Widmeyer, W. N. (1999). Relationship between collective efficacy and team cohesion: Conceptual and measurement issues. Group Dynamics: Theory, Research, and Practice, 3, 210-222.
58. Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level and cross-level perspectives. In L. L. Cumings & B. M. Staw (Eds.), Research in organizational behavior (Vol. 7, pp. 1-37). Greenwich, CT: JAI.
59. Sanchez-Ku, M. L., & Arthur, W., Jr. (2000). A dyadic protocol for training complex skills: A replication using female participants. Human Factors, 42, 512-520.
60. Schneider, B., Salvaggio, A. M., & Subirats, M. (2002). Climate strength: A new direction for climate research. Journal of Applied Psychology, 87, 220-229.
61. Shebilske, W. L., Regian, J. W., Arthur, W., Jr., & Jordan, J. A. (1992). A dyadic protocol for training complex skills. Human Factors, 34, 369-374.
62. Solano, C. H., & Dunnam, M. (1985). Two's company: Self-disclosure and reciprocity in triads versus dyads. Social Psychology Quarterly, 48, 183-187.
63. Stajkovic, A. D., & Luthans, F. (1998). Self-efficacy and work-related performance: A meta-analysis. Psychological Bulletin, 124, 240-261.
64. Tesluk, P., Mathieu, J. E., Zaccaro, S. J., & Marks, M. (1997). Task and aggregation issues in the analysis and assessment of team performance. In M. T. Brannick, C. Prince, & E. Salas (Eds.), Team performance assessment and measurement (pp. 197-224). Mahwah, NJ: Lawrence Erlbaum.
65. Vancouver, J. B. (2005). The depth of history and explanation as benefit and bane for psychological control theories. Journal of Applied Psychology, 90, 38-52.
66. Wanous, J. P., & Hudy, M. J. (2001). Single-item reliability: A replication and extension. Organizational Research Methods, 4, 361-375.
67. Whiteoak, J. W., Chalip, L., & Hort, L. K. (2004). Assessing group efficacy: Comparing three methods of measurement. Small Group Research, 35, 158-173.