An evaluation of information criteria use for correct cross-classified random effects model selection

Journal of Experimental Education

Volumn 81, Issue 4, 2013, Pages 429-463

  Beretvas, S Natasha ^a   Murphy, Daniel L ^b  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b PEARSON   (United States)

Author keywords

cross classified model; information criteria; model fit indices; multilevel model

Indexed keywords

EID: 84883559611     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220973.2012.745467     Document Type: Conference Paper

References (34)

1. Akaike, H. 1973. " Information theory and an extension of the maximum likelihood principle ". In Second international symposium on information theory, Edited by: Petrov, B. N. and Csaki, F. 267-281. Budapest, Hungary: Akademiai Kiado.
2. Beretvas, S. N. 2008. " Cross-classified random effects models ". In Multilevel modeling of educational data, Edited by: OConnell, A. A. and Betsy McCoach, D. 161-197. Charlotte, SC: Information Age.
3. Beretvas, S. N. 2010. " Cross-classified and multiple membership models ". In The handbook of advanced multilevel analysis, Edited by: Hox, J. and Roberts, J. K. 313-334. New York, NY: Routledge.
4. Bozdogan, H. 1987. Model selection and Akaike's information criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52: 345-370.
5. Bradley, J. V. 1978. Robustness?. British Journal of Mathematical and Statistical Psychology, 31: 144-152.
6. Ecob, R., Croudace, T. J., White, I. R., Evans, J. E., Harrison, G. L., Sharp, D., and, Jones, P. B. 2004. Multilevel investigation of variation in HoNOS ratings by mental health professionals: A naturalistic study of consecutive referrals. International Journal of Methods in Psychiatric Research, 13: 152-164.
7. Fielding, A. 2002. Teaching groups as foci for evaluating performance in cost-effectiveness of GCE advanced-level provision: Some practical methodological innovations. School Effectiveness and School Improvement, 13: 225-246.
8. Garner, C. L., and, Raudenbush, S. W. 1991. Neighborhood effects on educational attainment: A multilevel analysis. Sociology of Education, 64: 251-262.
9. Gelman, A., and, Rubin, D. B. 1995. " Avoiding model selection in Bayesian social research. Discussion of "Bayesian model selection in social research," by A. Raftery ". In Sociology methodology, Edited by: Marsden, P. V. 165-173. Cambridge, MA: Blackwell.
10. Goldstein, H. 2003. Multilevel statistical models (3rd ed.), New York, NY: Hodder Arnold.
11. Goldstein, H. 2010. Multilevel statistical models (4th ed.), New York, NY: Hodder Arnold.
12. Goldstein, H., and, Sammons, P. 1997. The influence of secondary and junior schools on sixteen year examination performance: A cross-classified multilevel analysis. School Effectiveness and School Improvement, 8: 219-230.
13. Gurka, M. J. 2006. Selecting the best linear mixed model under REML. The American Statistician, 60: 19-26.
14. Hannon, E. J., and, Quinn, B. G. 1979. The determination of the order of an autoregression. Journal of the Royal Statistical Society, Series B, 41: 190-195.
15. Harville, D. A. 1974. Bayesian inference for variance components using only error contrasts. Biometrika, 61: 383-385.
16. Hox, J. 2002. Multilevel analysis: Techniques and applications, Mahwah, NJ: Erlbaum.
17. Hurvich, C. M., and, Tsai, C. L. 1989. Regression and time series model selection in small samples. Biometrika, 76: 297-307.
18. Kass, R. E., and, Raftery, A. E. 1995. Bayes factors. Journal of the American Statistical Association, 90: 773-795.
19. Luo, W., and, Kwok, O. 2009. The impacts of ignoring a crossed factor in analyzing cross-classified data. Multivariate Behavioral Research, 44: 182-212.
20. Meyers, J. L., and, Beretvas, S. N. 2006. The impact of inappropriate modeling of cross-classified data structures. Multivariate Behavioral Research, 41: 473-497.
21. Pickery, J., Loosveldt, G., and, Carton, A. 2001. The effects of interviewer and respondent characteristics on response behavior in panel surveys: A multilevel approach. Sociological Methods and Research, 29: 509-523.
22. Raftery, A. E. 1995. " Bayesian model selection in social research ". In Sociology methodology, Edited by: Marsden, P. V. 95-111. Cambridge, MA: Blackwell.
23. Rasbash, J., and, Browne, W. J. 2001. " Modeling non-hierarchical structures ". In Multilevel modeling of health statistics, Edited by: Leyland, A. H. and Goldstein, H. 93-105. Chichester, England: Wiley.
24. Raudenbush, S. W., and, Bryk, A. S. 2002. Hierarchical linear models: Applications and data analysis methods (2nd ed.), Thousand Oaks, CA: Sage.
25. Raudenbush, S. W., and, Liu, X. 2000. Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5: 199-213.
26. Schwarz, G. 1978. Estimating the dimension of a model. Annals of Statistics, 6: 461-464.
27. Shi, Y., Leite, W. L., and, Algina, J. 2010. The impact of omitting the interaction between crossed factors in cross-classified random effects modelling. British Journal of Mathematical and Statistical Psychology, 63: 1-15.
28. Snijders, T. A. B., and, Bosker, R. J. 1999. Multilevel analysis: An introduction to basic and advanced multilevel modeling, Thousand Oaks, CA: Sage.
29. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., and, van der Linde, A. 2002. Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society B, 64: 583-640.
30. Spybrook, J., and, Raudenbush, S. W. 2009. An examination of the precision and technical accuracy of the first wave of group-randomized trials funded by the Institute of Education Sciences. Educational Evaluation and Policy Analysis, 31: 298-318.
31. Szapocznik, J., Lombard, J., Martinez, F., Mason, C. A., Gorman-Smith, D., Plater-Zyberk, E., and, Spokane, A. 2006. The impact of the built environment on children's school conduct grades: The role of diversity of use in a Hispanic neighborhood. American Journal of Community Psychology, 38: 299-310.
32. Verbeke, G., and, Molenerghs, G. 2000. Linear mixed models for longitudinal data, New York, NY: Springer-Verlag.
33. West, P., Sweeting, H., and, Leyland, A. 2004. School effects on pupils health behaviours: Evidence in support of the health promoting school. Research Papers in Education, 19: 261-291.
34. Whittaker, T. A., and, Furlow, C. F. 2009. The comparison of model selection criteria when selecting among competing hierarchical linear models. Journal of Modern Applied Statistical Methods, 8: 173-193.