Specification searches in multilevel structural equation modeling: A monte carlo investigation

Structural Equation Modeling

Volumn 17, Issue 1, 2010, Pages 42-65

  Peugh, James L ^a   Enders, Craig K ^b  

^a UNIVERSITY OF VIRGINIA   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BETWEEN-CLUSTER VARIATION; CLUSTER SAMPLING; DELETION METHODS; FUTURE RESEARCH DIRECTIONS; INDIVIDUAL DIFFERENCES; INTRACLASS CORRELATION COEFFICIENTS; MULTILEVEL STRUCTURAL EQUATION; WITHIN CLUSTERS;

RESEARCH;

SPECIFICATIONS;

EID: 75149138257     PISSN: 10705511     EISSN: None     Source Type: Journal    
DOI: 10.1080/10705510903438948     Document Type: Article

References (60)

1. Akaike, H. (1973). Information theory and the extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), 2nd International Symposium on Information Theory (pp. 267-281). Budapest, Hungary: Akademia Kiado.
2. Berger, M. P. (1978). A note on the use of simultaneous test procedures. Psychological Bulletin, 85, 895-897.
3. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
4. Boomsma, A. (1983). On the robustness of LISREL (maximum likelihood estimation) against small sample size and nonnormality. Amsterdam: Sociometric Research Foundation.
5. Burt, S. A., McGue, M., & Krueger, R. F. (2007). Environmental contributions to adolescent delinquency: A fresh look at the shared environment. Journal of Abnormal Child Psychology, 35, 787-800.
6. Chou, C.-P., & Bentler, P. M. (1990). Model modification in covariance structure modeling: A comparison among likelihood ratio, Wald, and Lagrange multiplier tests. Multivariate Behavioral Research, 25, 115-136.
7. Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330-351.
8. Cronbach, L. J., & Webb, N. (1975). Between-class and within-class effects of repeated aptitude x treatment interaction: Re-analysis of a study by G. L. Anderson. Journal of Educational Psychology, 67, 717-724.
9. Fan, X., & Wang, L. (1998). Effects of potential confounding factors on fit indices and parameter estimates for true and miss-specified models. Structural Equation Modeling, 5, 701-735.
10. Fan, X., Wang, L., & Thompson, B. (1997, April). Effects of data non-normality and other factors on fit indices and parameter estimates for the true and miss-specified SEM models. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
11. Finch, J. F., West, S. G., & MacKinnon, D. P. (1997). Effects of sample size and non-normality on the estimation of mediated effects in latent variable models. Structural Equation Modeling, 4, 87-105.
12. Green, S. B., & Babyak, M. A. (1997). Control of Type I errors with multiple tests of constraints in structural equation modeling. Multivariate Behavioral Research, 32, 39-51.
13. Green, S. B., Thompson, M. S., & Babyak, M. A. (1998). A Monte Carlo investigation of methods for controlling Type-I errors with specification searches in structural equation modeling. Multivariate Behavioral Research, 33, 365-383.
14. Green, S. B., Thompson, M. S., & Poirier, J. (1999). Exploratory analyses to improve model fit: Errors due to misspecification and a strategy to reduce their occurrence. Structural Equation Modeling, 6, 113-126.
15. Green, S. B., Thompson, M. S., & Poirier, J. (2001). An adjusted Bonferroni method for elimination of parameters in specification addition searches. Structural Equation Modeling, 8, 18-39.
16. Harnqvist, K. (1978). Primary mental abilities of collective and individual levels. Journal of Educational Psychology, 70, 706-716.
17. Heck, R. H. (2001). Multilevel modeling with SEM. In G. A. Marcoulides & R. E. Schumacker (Eds.), New developments and techniques in structural equation modeling (pp. 89-127). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
18. Henry, G. T. (1990). Practical sampling. Newbury Park, CA: Sage.
19. Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
20. Hox, J. J. (1993). Factor analysis of multilevel data: Gauging the Muthén model. In J. H. L. Oud & R. A. W. van Blokland-Vogelesang (Eds.), Advances in longitudinal and multivariate analysis in the behavioral sciences (pp. 141-156). Nijmegen, The Netherlands: ITS.
21. Hox, J. J. (1994). Applied multilevel analysis. Amsterdam: TT-Publikaties.
22. Hox, J. J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
23. Hox, J. J. (2004). Multilevel multivariate and structural equation models: Some missing links. Unpublished manuscript. Retrieved June 1, 2007, from http://www.fss.uu.nl/ms/jh/papers/papers.htm
24. Hox, J. J., & Maas, C. J. M. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling, 8, 157-174.
25. Jöreskog, K. G., & Sörbom, D. (1984). LISREL-VI: Analysis of linear structural relationships by the method of maximum likelihood. Mooresville, IL: Scientific Software.
26. Jöreskog, K. G., & Sörbom, D. (1989). LISREL 7: A guide to the program and applications. Chicago, IL: SPSS.
27. Julian, M. W. (2001). The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Structural Equation Modeling, 8, 325-352.
28. Kaplan, D. (1988). The impact of specification error on the estimation, testing, and improvement of structural equation models. Multivariate Behavioral Research, 23, 69-86.
29. Kaplan, D. (2000). Structural equation modeling: Foundations and extensions. Thousand Oaks, CA: Sage.
30. Kaplan, D., & Elliott, P. R. (1997a). A didactic example of multilevel structural equation modeling applicable to the study of organizations. Structural Equation Modeling, 4, 1-24.
31. Kaplan, D., & Elliott, P. R. (1997b). A model-based approach to validating education indicators using multilevel structural equation modeling. Journal of Educational and Behavioral Statistics, 22, 323-347.
32. Kaplan, D., & Kreisman, M. B. (2000). On the validation of indicators of mathematics education using TIMMS: An application of multilevel covariance structure modeling. International Journal of Educational Policy, Research, & Practice, 1, 217-242.
33. Kaplan, D., & Wenger, R. N. (1993). Asymptotic independence and separability in covariance structure models. Implications for specification error, power, and model modification. Multivariate Behavioral Research, 28, 467-482.
34. Kline, R. B. (2004). Principles and practices of structural equation modeling (2nd ed.). New York: Guilford.
35. Leite, W. L., Huang, I.-C., & Marcoulides, G. A. (2008). Item selection for the development of short-forms of scales using an ant colony optimization algorithm. Multivariate Behavioral Research, 43, 411-431.
36. Li, F., Duncan, T. E., Harmer, P., Acock, A., & Stoolmiller, M. (1998). Analyzing measurement models of latent variables through multilevel confirmatory factor analysis and hierarchical linear modeling approaches. Structural Equation Modeling, 5, 294-306.
37. Maas, C. J. M., & Hox, J. J. (2004). Robustness of multilevel parameter estimates against small sample sizes. Unpublished manuscript. Retrieved July 11, 2007, from http://www.fss.uu.nl/ms/jh/papers/papers.htm
38. MacCallum, R. (1986). Specification searches in covariance structure modeling. Psychological Bulletin, 100, 107-120.
39. Marcoulides, G. A., & Drezner, Z. (2003). Model specification searches using Ant Colony optimization algorithms. Structural Equation Modeling, 10, 154-164.
40. Marcoulides, G. A., Drezner, Z., & Schumacker, R. E. (1998). Model specification searches in structural equation modeling using Tabu search. Structural Equation Modeling, 5, 365-376.
41. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
42. Muthén, B. O. (1989). Latent variable modeling in heterogeneous populations. Psychometrika, 54, 557-585.
43. Muthén, B. O. (1990). Means and covariance structure analysis of hierarchical data (UCLA Statistics Series No. 62). Los Angeles, CA: UCLA.
44. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338-354.
45. Muthén, B. O. (1994). Multilevel covariance structure analysis. Sociological Methods and Research, 22, 376-398.
46. Muthén, B. O., & Satorra, A. (1989). Multilevel aspects of varying parameters in structural models. In R. D. Bock (Ed.), Multilevel analysis of educational data (pp. 87-99). San Diego, CA: Academic.
47. Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. In P. V. Marsden (Ed.), Sociological methodology, 1995 (pp. 267-316). Oxford, UK: Blackwell.
48. Muthén, L. K., & Muthén, B. O. (1998-2006). Mplus users guide (4th ed.). Los Angeles: Muthén & Muthén.
49. Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000). The performance of ML, GLS, and WLS estimation in structural equation modeling under conditions of misspecification and nonnormality. Structural Equation Modeling, 7, 557-595.
50. Olsson, U. H., Troye, S. V., & Howell, R. D. (1999). Theoretic fit and empirical fit: The performance of maximum likelihood versus generalized least squares estimation in structural equation models. Multivariate Behavioral Research, 34, 31-58.
51. Paxton, P., Curran, P. J., Bollen, K. A., Kirby, J., & Chen, F. (2001). Monte Carlo experiments: Design and implementation. Structural Equation Modeling, 8, 287-312.
52. Raftery, A. E. (1988). Approximate Bayes factors for generalized linear models (Tech. Rep. No. 121). Seattle, WA: University of Washington, Department of Statistics.
53. Rao, P. S. R. S. (2000). Sampling methodologies with applications: Texts in statistical science. New York: Chapman & Hall/CRC.
54. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
55. Roth, D. L., Wiebe, D. J., Fillingim, R. B., & Shay, K. A. (1989). Life events, fitness, hardiness, and health: A simultaneous analysis of proposed stress-resistance effects. Journal of Personality and Social Psychology, 57, 136-142.
56. Rowe, K. J. (2003). Estimating interdependent effects among multilevel composite variables in psychosocial research: An example of the application of multilevel structural equation modeling. In S. P. Reise & N. Duan (Eds.), Multilevel modeling: Methodological advances, issues and applications (pp. 255-284). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
57. Ryu, E. (2008). Evaluation of model fit in multilevel structural equation modeling: Level-specific model fit evaluation and the robustness to nonnormality. Unpublished doctoral dissertation, Arizona State University, Tempe, AZ.
58. Silvia, E. S. M., & MacCallum, R. C. (1988). Some factors affecting the success of specification searches in covariance structure modeling. Multivariate Behavioral Research, 23, 297-326.
59. Sörbom, D. (1989). Model modification. Psychometrika, 54, 371-384.
60. Stapleton, L. M. (2006). Using multilevel structural equation modeling techniques with complex sample data. In G. R. Hancock & R. Mueller (Eds.), A second course in structural equation modeling (pp. 345-384). Greenwich, CT: Information Age.