Does Excluding Some Groups From Research Designs Improve Statistical Power?

Small Group Research

Volumn 43, Issue 4, 2012, Pages 387-409

  Biemann, Torsten ^a   Heidemeier, Heike ^b  

^a UNIVERSITY OF COLOGNE   (Germany)

^b JACOBS UNIVERSITY BREMEN   (Germany)

Author keywords

group size; interrater agreement; statistical power

Indexed keywords

EID: 84863508798     PISSN: 10464964     EISSN: 15528278     Source Type: Journal    
DOI: 10.1177/1046496412443088     Document Type: Article

References (58)

1. Allen N. J.,Stanley D. J.,Williams H. M.,Ross S. J.Assessing the impact of nonresponse on work group diversity effects.Organizational Research Methods. 2007;10:262-286.
2. Ancona D. G.,Caldwell D. F.Demography and design: Predictors of new product team performance.Organization Science. 1992;3:321-341.
3. Balkundi P.,Harrison D. A.Ties, leaders, and time in teams: Strong inference about network structure's effects on team viability and performance.Academy of Management Journal. 2006;49:49-68.
4. Beal D. J.,Cohen R. R.,Burke M. J.,McLendon C. L.Cohesion and performance in groups: A meta-analytic clarification of construct relations.Journal of Applied Psychology. 2003;88:989-1004.
5. Bell S. T.Deep-level composition variables as predictors of team performance: A meta-analysis.Journal of Applied Psychology. 2007;92:595-615.
6. Bliese P. D.Multilevel theory, research, and methods in organizations. Klein K. J.Kozlowski S. W. J., ed. San Francisco, CA: Jossey-Bass; 2000:349-381.
7. Bollen K. A.,Lennox R.Conventional wisdom on measurement: A structural equation perspective.Psychological Bulletin. 1991;110:305-314.
8. Bowers C. A.,Pharmer J. A.,Salas E.When member homogeneity is needed in work teams: A meta-analysis.Small Group Research. 2000;31:305-327.
9. Burke C. S.,Stagl K. C.,Klein C.,Goodwin G. F.,Salas E.,Halpin S. M.What type of leadership behaviors are functional in teams? A meta-analysis.Leadership Quarterly. 2006;17:288-307.
10. Cohen J.Statistical power analysis for the behavioral sciences. 1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.Hillsdale, NJ: Lawrence Erlbaum; 1988:.
11. Cohen J.A power primer.Psychological Bulletin. 1992;112:155-159.
12. Croon M. A.,van Veldhoven M. J. P. M.Predicting group-level outcome variables from variables measured at the individual level: A latent variable multilevel model.Psychological Methods. 2007;12 (1): 45-57.
13. Dawson J. F.Do we have enough? The accuracy of incomplete data from small groups. Seattle, WA: Academy of Management Best Paper Proceedings; 2003:.
14. De Dreu C. K. W.,Weingart L. R.Task versus relationship conflict, team performance, and team member satisfaction: A meta-analysis.Journal of Applied Psychology. 2003;88:741-749.
15. Devine D. J.,Philips J. L.Do smarter teams do better? A meta-analysis of cognitive ability and team performance.Small Group Research. 2001;32:507-532.
16. Diamantopoulos A.,Winklhofer H. M.Index construction with formative indicators: An alternative to scale development.Journal of Marketing Research. 2001;38:269-277.
17. Drach-Zahavy A.,Somech A.Understanding team innovation: The role of team processes and structures.Group Dynamics: Theory, Research, and Practice. 2001;5:111-123.
18. Eigel K. M.,Kuhnert K. W.Selected research on work team diversity. Ruderman M. N.Hughes-James M. W.Jackson S. E., ed. Washington, DC: American Psychological Association; 1996:75-98.
19. Glick W. H.Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research.Academy of Management Review. 1985;10:601-616.
20. Gully S. M.,Incalcaterra K. A.,Joshi A.,Beaubien J. M.A meta-analysis of team-efficacy, potency, and performance: Interdependence and level of analysis as moderators of observed relationships.Journal of Applied Psychology. 2002;87:819-832.
21. Harrison D. A.,Klein K. J.What's the difference? Diversity constructs as separation, variety, or disparity in organizations.Academy of Management Review. 2007;32:1199-1228.
22. Horwitz S. K.,Horwitz I. B.The effects of team diversity on team outcomes: A meta-analytic review of team demography.Journal of Management. 2007;33:987-1015.
23. House R. J.Leadership: The cutting edge. Hunt J. G.Larson L. L., ed. Carbondale: Southern Illinois University Press; 1977:189-207.
24. Howell R. D.,Breivik E.,Wilcox J. B.Reconsidering formative measurement.Psychological Methods. 2007;12:205-218.
25. James L. R.Aggregation bias in estimates of perceptual agreement.Journal of Applied Psychology. 1982;67:219-229.
26. James L. R.,Choi C. C.,Ko C. H. E.,McNeil P. K.,Minton M. K.,Wright M. A.,Kim K. I.Organizational and psychological climate: A review of theory and research.European Journal of Work and Organizational Psychology. 2008;17:5-32.
27. James L. R.,Demaree R. G.,Wolf G.Estimating within-group interrater reliability with and without response bias.Journal of Applied Psychology. 1984;69:85-98.
28. Jehn K. A.,Northcraft G. B.,Neale M. A.Why differences make a difference: A field study of diversity, conflict, and performance in workgroups.Administrative Science Quarterly. 1999;44:741-763.
29. Kenny D. A.,Manetti L.,Pierro A.,Livi S.,Kashy D. A.The statistical analysis of data from small groups.Journal of Personality and Social Psychology. 2002;83:126-137.
30. Klein K. J.,Conn A. B.,Smith D. B.,Sorra J. S.Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment.Journal of Applied Psychology. 2001;86:3-16.
31. LePine J. A.,Piccolo R. F.,Jackson C. L.,Mathieu J. E.,Saul J. R.A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria.Personnel Psychology. 2008;61:273-307.
32. Lichtenstein R.,Alexander J. A.,Jinnett K.,Ullman E.Embedded intergroup relations in interdisciplinary teams: Effects on perceptions of level of team integration.Journal of Applied Behavioral Science. 1997;33:413-434.
33. Lüdtke O.,Marsh H. W.,Robitzsch A.,Trautwein U.,Asparouhov T.,Muthén B.The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies.Psychological Methods. 2008;13:203-229.
34. MacKenzie S. B.,Podsakoff P. M.,Jarvis C. B.The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions.Journal of Applied Psychology. 2005;90:710-730.
35. Mathieu J.,Maynard M. T.,Rapp T.,Gilson L.Team effectiveness 1997-2007: A review of recent advancements and a glimpse into the future.Journal of Management. 2008;34:410-476.
36. Maxwell S. E.The persistence of underpowered studies in psychological research: Causes, consequences, and remedies.Psychological Methods. 2004;9:147-163.
37. Mayo M.,Pastor J. C.,Meindl J. R.The effects of group heterogeneity on the self-perceived efficacy of group leaders.Leadership Quarterly. 1996;7:265-284.
38. Moreland R. L.Are dyads really groups?.Small Group Research. 2010;41:251-267.
39. Murray D. M.Design and analysis of group-randomized trials. Oxford, UK: Oxford University Press; 1998:.
40. Nesterkin D. A.,Ganster D. C.The effects of nonresponse rates on group-level correlations.Journal of Management. in press.
41. Newman D. A.,Sin H.-P.How do missing data bias estimates of within-group agreement? Sensitivity of SDWG, CVWG, rWG(J), rWG(J)*, and ICC to systematic nonresponse.Organizational Research Methods. 2009;12:113-147.
42. Nunnally J. C.,Bernstein I. H.Psychometric theory. 1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1994:.
43. O'Reilly C. A.,Caldwell D. F.,Barnett W. P.Work group demography, social integration, and turnover.Administrative Science Quarterly. 1989;34:21-37.
44. Pfeffer J.,Langton N.Wage inequality and the organization of work: The case of academic departments.Administrative Science Quarterly. 1988;33:588-606.
45. Preacher K. J.,Zyphur M. J.,Zhang Z.A general multilevel SEM framework for assessing multilevel mediation.Psychological Methods. 2010;15:209-233.
46. R Development Core Team. (Ed.). (2010). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.r-project.org.
47. Raudenbush S. W.,Liu X.Statistical power and optimal design for multisite randomized trials.Psychological Methods. 2000;5:199-213.
48. Scherbaum C. A.,Ferreter J. M.Estimating statistical power and required sample sizes for organizational research using multilevel modeling.Organizational Research Methods. 2009;12:347-367.
49. Schippers M. C.,Den Hartog D. N.,Koopman P. L.,Wienk J. A.Diversity and team outcomes: The moderating effects of outcome interdependence and group longevity and the mediating effect of reflexivity.Journal of Organizational Behavior. 2003;24:779-802.
50. Schmidt F. L.Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers.Psychological Methods. 1996;1:115-129.
51. Schneider B.,Ehrhart M. G.,Mayer D. M.,Saltz J. L.,Niles-Jolly K.Understanding organization-customer links in service settings.Academy of Management Journal. 2005;48:1017-1032.
52. Simons T.,Pelled L. H.,Smith K. A.Making use of difference: Diversity, debate, and decision comprehensiveness in top management teams.Academy of Management Journal. 1999;42:662-673.
53. Snijders T. A.,Bosker R. J.Standard errors and sample sizes in two-level research.Journal of Educational and Behavioral Statistics. 1993;18:237-259.
54. Stewart G. L.A meta-analytic review of relationships between team design features and team performance.Journal of Management. 2006;32:29-54.
55. Timmerman T. A.Missing persons in the study of groups.Journal of Organizational Behavior. 2005;26:21-36.
56. Van Knippenberg D.,De Dreu C. K. W.,Homan A. C.Work group diversity and group performance: An integrative model and research agenda.Journal of Applied Psychology. 2004;89:1008.
57. Webber S. S.,Donahue L. M.Impact of highly and less job-related diversity on work group cohesion and performance: A meta-analysis.Journal of Management. 2001;27:141-162.
58. West C. T.,Schwenk C. R.Top management team strategic consensus, demographic homogeneity and firm performance: A report of resounding nonfindings.Strategic Management Journal. 1996;17:571-576.