The problem of model selection uncertainty in structural equation modeling

Psychological Methods

Volumn 17, Issue 1, 2012, Pages 1-14

  Preacher, Kristopher J ^a   Merkle, Edgar C ^b  

^a VANDERBILT UNIVERSITY   (United States)

^b UNIVERSITY OF MISSOURI   (United States)

Author keywords

BIC; Information criteria; Model selection; Structural equation modeling

Indexed keywords

ARTICLE; BAYES THEOREM; CONFIDENCE INTERVAL; DECISION SUPPORT SYSTEM; HUMAN; INFORMATION SCIENCE; NONPARAMETRIC TEST; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL; UNCERTAINTY;

BAYES THEOREM; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; DECISION SUPPORT TECHNIQUES; HUMANS; INFORMATION THEORY; MODELS, STATISTICAL; SAMPLE SIZE; STATISTICS, NONPARAMETRIC; UNCERTAINTY;

EID: 84866522194     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0026804     Document Type: Article

References (52)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csáki (Eds.), Second International Symposium on Information Theory (pp. 267-281). Budapest, Hungary: Akadémiai Kiadó.
2. Atkinson, A. C. (1978). Posterior probabilities for choosing a regression model. Biometrika, 65, 39-48. doi:10.1093/biomet/65.1.39
3. Bentler, P. M., & Mooijaart, A. (1989). Choice of structural model via parsimony: A rationale based on precision. Psychological Bulletin, 106, 315-317. doi:10.1037/0033-2909.106.2.315
4. Bollen, K. A., & Long, J. S. (Eds.). (1993). Testing structural equation models. Newbury Park, CA: Sage.
5. Bollen, K. A., & Stine, R. A. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21, 205-229. doi:10.1177/0049124192021002004
6. Browne, M. W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83. doi:10.1111/j.2044-8317 .1984.tb00789.x
7. Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230-258. doi:10.1177/ 0049124192021002005
8. Burnham, K. P., & Anderson, D. R. (2002). Model selection and multi-model inference: A practical information-theoretic approach (2nd ed.). New York, NY: Springer.
9. Burnham, K. P., & Anderson, D. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33, 261-304. doi:10.1177/0049124104268644
10. Cudeck, R., & Browne, M. W. (1983). Cross-validation of covariance structures. Multivariate Behavioral Research, 18, 147-167. doi:10.1207/ s15327906mbr1802_2
11. Cudeck, R., & Henly, S. J. (1991). Model selection in covariance structures analysis and the "problem" of sample size: A clarification. Psychological Bulletin, 109, 512-519.
12. Curran, P. J., Bollen, K. A., Paxton, P., Kirby, J., & Chen, F. (2002). The noncentral chi-square distribution in misspecified structural equation models: Finite sample results from a Monte Carlo simulation. Multivariate Behavioral Research, 37, 1-36. doi:10.1207/S15327906MBR3701_01
13. Freedman, D. A., Navidi, W. C., & Peters, S. C. (1988). On the impact of variable selection in fitting regression equations. In T. K. Dijkstra (Ed.), On model uncertainty and its statistical implications (pp. 1-16). Berlin, Germany: Springer-Verlag. doi:10.1007/978-3-642-61564-1_1
14. Haughton, D. M. A., Oud, J. H. L., & Jansen, R. A. R. G. (1997). Information and other criteria in structural equation model selection. Communications in Statistics: Simulation and Computation, 26, 1477- 1516. doi:10.1080/03610919708813451
15. Herzog, W., & Boomsma, A. (2009). Small-sample robust estimators of noncentrality-based and incremental model fit. Structural Equation Modeling, 16, 1-27. doi:10.1080/10705510802561279
16. Homburg, C. (1991). Cross-validation and information criteria in causal modeling. Journal of Marketing Research, 28, 137-144. doi:10.2307/ 3172803
17. Jeffreys, H. (1961). Theory of probability. Oxford, England: Oxford University Press.
18. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795. doi:10.2307/2291091
19. Kim, I. J., Zane, N. W. S., & Hong, S. (2002). Protective factors against substance use among Asian American youth: A test of the peer cluster theory. Journal of Community Psychology, 30, 565-584. doi:10.1002/ jcop.10022
20. Kuha, J. (2004). AIC and BIC: Comparisons of assumptions and performance. Sociological Methods & Research, 33, 188-229. doi:10.1177/ 0049124103262065
21. Lee, S.-Y. (2007). Structural equation modeling: A Bayesian approach. Chichester, England: Wiley. doi:10.1002/9780470024737
22. Lee, S.-Y., & Song, X.-Y. (2001). Hypothesis testing and model comparison in two-level structural equation models. Multivariate Behavioral Research, 36, 639-655. doi:10.1207/S15327906MBR3604_07
23. Lee, S.-Y., & Song, X.-Y. (2008). Bayesian model comparison of structural equation models. In D. B. Dunson (Ed.), Random effect and latent variable model selection (pp. 121-150). New York, NY: Springer. doi:10.1007/978-0-387-76721-5_6
24. Linhart, H., & Zucchini, W. (1986). Model selection. New York, NY: Wiley.
25. MacCallum, R. C. (2003). Working with imperfect models. Multivariate Behavioral Research, 38, 113-139. doi:10.1207/S15327906MBR3801_5
26. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149. doi:10.1037/1082-989X.1.2.130
27. McDonald, R. P. (1989). An index of goodness-of-fit based on noncentrality. Journal of Classification, 6, 97-103. doi:10.1007/BF01908590
28. Mulaik, S. A. (2009). Linear causal modeling with structural equations. Boca Raton, FL: Chapman & Hall/CRC.
29. Mulaik, S. A., James, L. R., Van Alstine, J., Bennett, N., Lind, S., & Stilwell, C. D. (1989). Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105, 430-445. doi: 10.1037/0033-2909.105.3.430
30. Nagin, D. S. (1999). Analyzing developmental trajectories: A semiparametric, group-based approach. Psychological Methods, 4, 139-157. doi:10.1037/1082-989X.4.2.139
31. Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14, 535-569. doi:10.1080/10705510701575396
32. Preacher, K. J. (2006). Quantifying parsimony in structural equation modeling. Multivariate Behavioral Research, 41, 227-259. doi:10.1207/ s15327906mbr4103_1
33. Preacher, K. J., Cai, L., & MacCallum, R. C. (2007). Alternatives to traditional model comparison strategies for covariance structure models. In T. D. Little, J. A. Bovaird, & N. A. Card (Eds.), Modeling contextual effects in longitudinal studies (pp. 33-62). Mahwah, NJ: Erlbaum.
34. Raftery, A. E. (1993). Bayesian model selection in structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 163-180). Newbury Park, CA: Sage.
35. Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111-163. doi:10.2307/271063
36. Raftery, A. E. (1999). Bayes factors and BIC: Comment on "A critique of the Bayesian information criterion for model selection." Sociological Methods & Research, 27, 411-427. doi:10.1177/0049124199027003005
37. Raykov, T. (2001). Approximate confidence interval for difference in fit of structural equation models. Structural Equation Modeling, 8, 458-469. doi:10.1207/S15328007SEM0803_6
38. Raykov, T., & Marcoulides, G. A. (1999). On desirability of parsimony in structural equation model selection. Structural Equation Modeling, 6, 292-300. doi:10.1080/10705519909540135
39. Schenker, N., & Gentleman, J. F. (2001). On judging the significance of differences by examining the overlap between confidence intervals. American Statistician, 55, 182-186. doi:10.1198/000313001317097960
40. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464. doi:10.1214/aos/1176344136
41. Steiger, J. H. (2000). Point estimation, hypothesis testing, and interval estimation using the RMSEA: Some comments and a reply to Hayduk and Glaser. Structural Equation Modeling, 7, 149-162. doi:10.1207/ S15328007SEM0702_1
42. Steiger, J. H., & Lind, J. C. (1980, May). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
43. Steiger, J. H., Shapiro, A., & Browne, M. W. (1985). On the multivariate asymptotic distribution of sequential chi-square statistics. Psychometrika, 50, 253-263. doi:10.1007/BF02294104
44. Tofighi, D., & Enders, C. K. (2007). Identifying the correct number of classes in a growth mixture model. In G. R. Hancock & K. M. Samuelsen (Eds.), Mixture models in latent variable research (pp. 317-341). Greenwich, CT: Information Age.
45. Wasserman, L. (1997). Bayesian model selection and model averaging (Working Paper No. 666). Carnegie Mellon University, Department of Statistics.
46. Weakliem, D. L. (1999). A critique of the Bayesian information criterion for model selection. Sociological Methods & Research, 27, 359-397. doi:10.1177/0049124199027003002
47. Yanagihara, H., & Ohmoto, C. (2005). On distribution of AIC in linear regression models. Journal of Statistical Planning and Inference, 133, 417-433. doi:10.1016/j.jspi.2004.03.016
48. Yuan, K.-H. (2008). Noncentral chi-square versus normal distributions in describing the likelihood ratio statistic: The univariate case and its multivariate implication. Multivariate Behavioral Research, 43, 109- 136. doi:10.1080/00273170701836729
49. Yuan, K.-H., & Bentler, P. M. (2007). Multilevel covariance structure analysis by fitting multiple single-level models. Sociological Methodology, 37, 53-82. doi:10.1111/j.1467-9531.2007.00182.x
50. Yuan, K.-H., & Hayashi, K. (2003). Bootstrap approach to inference and power analysis based on three test statistics for covariance structure models. British Journal of Mathematical and Statistical Psychology, 56, 93-110. doi:10.1348/000711003321645368
51. Yuan, K.-H., Hayashi, K., & Bentler, P. M. (2007). Normal theory likelihood ratio statistic for mean and covariance structure analysis under alternative hypotheses. Journal of Multivariate Analysis, 98, 1262-1282. doi:10.1016/j.jmva.2006.08.005
52. Yuan, K.-H., Hayashi, K., & Yanagihara, H. (2007). A class of population covariance matrices in the bootstrap approach to covariance structure analysis. Multivariate Behavioral Research, 42, 261-281. doi:10.1080/ 00273170701360662