The accuracy of significance tests for slope variance components in multilevel random coefficient models

Organizational Research Methods

Volumn 12, Issue 3, 2009, Pages 418-435

  LaHuis, David M ^a   Ferguson, Matthew W ^b  

^a WRIGHT STATE UNIVERSITY   (United States)

^b IBM   (United States)

Author keywords

Cross level interactions; Multilevel; Variance components

Indexed keywords

EID: 67649559953     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428107308984     Document Type: Article

References (37)

1. Bliese, P.D. (2002). Multilevel random coefficient modeling in organizational research: Examples using SAS and S-PLUS. In F. Drazgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 401-445). San Francisco: Jossey-Bass.
2. Bliese, P.D., & Britt, T.W. (2001). Social support, group consensus and stressor-strain relationships: Social context matters. Journal of Organizational Behavior, 22, 425-436.
3. Bryk, A.S., & Raudenbush, S.W. (1992). Hierarchical linear models for social and behavioral research: Applications and data analysis methods. Newbury Park, CA: Sage.
4. Bunderson, J.S. (2003). Recognizing and utilizing expertise in work groups: A status characteristics perspective. Administrative Science Quarterly, 48, 557-591.
5. Busing, F. (1993). Distributional characteristics of variance estimates in two-level models. Unpublished manuscript, Department of Psychometrics and Research Methodology, Leiden University, Leiden, the Netherlands.
6. Chen, G., Webber, S.S., Bliese, P.D., Mathieu, J.E., Payne, S.C., Born, D.H., et al. (2002). Simultaneous examination of the antecedents and consequences of efficacy beliefs at multiple levels. Human Performance, 15, 381-410.
7. Choi, J.N. (2006). Multilevel and cross-level effects of workplace attitudes and group member relations on interpersonal helping behavior. Human Performance, 19, 383-402.
8. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
9. Cohen, J., & Cohen, P. (1983). Applied multiple regression/ correlation analysis for the behavioral sciences (2 nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
10. Davison, M.L., Kwak, N., Seo, Y.S., & Choi, J. (2002). Using hierarchical linear models to examine moderator effects: Person-by-organization interactions. Organizational Research Methods, 5, 231-254.
11. Day, D.V., Sin, H.P., & Chen, T.T. (2004). Assessing the burdens of leadership: Effects of formal leadership roles on individual performance over time. Personnel Psychology, 57, 573-605. (Pubitemid 39483273)
12. Dominicus, A., Skrondal, A., Gjessing, H.K., Pederson, N.L., & Palmgren, J. (2006). Likelihood ratio tests in behavioral genetics: Problems and solutions. Behavior Genetics, 36, 331-340. (Pubitemid 43673576)
13. Harwell, M. (1997). An empirical study of Hedge's homogeneity test. Psychological Methods, 2, 219-231. (Pubitemid 127453667)
14. Hedges, L.V. (1994). Fixed effects models. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 285-299). New York: Russell Sage Foundation.
15. Hofmann, D.A., & Gavin, M.B. (1998). Centering decisions in hierarchical linear modeling: Implications for research in organizations. Journal of Management, 24, 623-641. (Pubitemid 128180021)
16. Hofmann, D.A., & Stetzer, A. (1998). The role of safety climate and communication in accident interpretation: Implications for learning from negative events. Academy of Management Journal, 41, 644-657. (Pubitemid 128335404)
17. Hox, J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum.
18. Huedo-Medina, T.B., Sanchez-Meca, J., Marin-Martinez, F., & Botella, J. (2006). Assessing heterogeneity in meta-analysis: Q statistic or I2 index ? Psychological Methods, 11, 193-206. (Pubitemid 44001277)
19. Jackson, S.E., & Joshi, A. (2004). Diversity in social context: A multi-attribute, multi-level analysis of team diversity and performance in a sales organization. Journal of Organizational Behavior, 25, 675-702. (Pubitemid 40019706)
20. Kidwell, R.E., Mossholder, K.W., & Bennett, N. (1997). Cohesiveness and organizational citizenship behavior: A multilevel analysis using work group and individuals. Journal of Management, 23, 775-793. (Pubitemid 127173462)
21. LaHuis, D.M., & Avis, J.M. (2007). Using multilevel random coefficient modeling to investigate rater effects in performance ratings. Organizational Research Methods, 10, 97-107. (Pubitemid 44954368)
22. Liao, H., & Chuang, A. (2004). A multilevel investigation of factors influencing employee service performance and customer outcomes. Academy of Management Journal, 47, 41-58. (Pubitemid 38422393)
23. Lunney, G.H. (1970). Using analysis of variance with a dichotomous dependent variable: An empirical study. Journal of Educational Measurement, 7, 263-269.
24. Maas, C.J., & Hox, J.J. (2004). Robustness issues in multilevel regression analysis. Statistica Netherlandica, 58, 127-137. (Pubitemid 38482843)
25. Mossholder, K.W., Bennett, N., & Martin, C.L. (1998). A multilevel analysis of procedural justice context. Journal of Organizational Behavior, 19, 131-141. (Pubitemid 128185364)
26. Muthi©n, L.K., & Muthi©n, B.O. (1998-2006). Mplus user's guide (4 th ed.). Los Angeles: Author.
27. Nauman, S., & Bennett, N. (2000). A case for procedural justice climate: Development and test of a multilevel model. Academy of Management Journal, 43, 881-889.
28. Ployhart, R.E., Holtz, B.C., & Bliese, P.D. (2002). Longitudinal data analysis applications of random coefficient modeling to leadership research. The Leadership Quarterly, 13, 455-486.
29. Raudenbush, S.W., & Bryk, A.S. (2002). Hierarchical linear models: Applications and data analysis methods (2 nd ed.). Thousand Oaks, CA: Sage.
30. Raudenbush, S.W., Bryk, A.S., Cheong, Y.K., & Congdon, R.T., Jr. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.
31. Raudenbush, S.W., & Liu, X. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5, 199-213.
32. Sacco, J.M., Scheu, C.R., Ryan, A.M., & Schmitt, N. (2003). An investigation of race and sex similarity effects in interviews: A multilevel approach to relational demography. Journal of Applied Psychology, 88, 852-865. (Pubitemid 37239701)
33. Self, S.G., & Liang, K.Y. (1987). Asymptotic properties of maximum likelihood estimator and likelihood ratio tests under nonstandard conditions. Journal of the American Statistical Association, 82, 605-610.
34. Snijders, T.A.B., & Bosker, R.J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
35. Stoel, R.D., Garre, F.G., Dolan, C., & van den Wittenboer, G. (2006). On the likelihood ratio test in structural equation modeling when parameters are subject to boundary constraints. Psychological Methods, 11, 439-455. (Pubitemid 44950903)
36. Stram, D.O., & Lee, J.W. (1994). Variance components testing in the longitudinal mixed effects model. Biometrics, 50, 1171-1177.
37. Yeo, G.B., & Neal, A. (2004). A multilevel analysis of effort, practice and performance: Effects of ability, conscientiousness, and goal orientation. Journal of Applied Psychology, 89, 231-247. (Pubitemid 38472508)