Fitting Multilevel Models With Ordinal Outcomes: Performance of Alternative Specifications and Methods of Estimation

Psychological Methods

Volumn 16, Issue 4, 2011, Pages 373-390

  Bauer, Daniel J ^a   Sterba, Sonya K ^b  

^a University of North Carolina at Chapel Hill   (United States)

^b VANDERBILT UNIVERSITY   (United States)

Author keywords

Cumulative logit model; Multilevel models; Ordinal; Proportional odds model; Random effects

Indexed keywords

ARTICLE; CLUSTER ANALYSIS; METHODOLOGY; MULTILEVEL ANALYSIS; PSYCHOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS;

CLUSTER ANALYSIS; DATA INTERPRETATION, STATISTICAL; LIKELIHOOD FUNCTIONS; LINEAR MODELS; LOGISTIC MODELS; MULTILEVEL ANALYSIS; PSYCHOLOGY; STATISTICS AS TOPIC;

EID: 83755185645     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0025813     Document Type: Article

References (40)

1. Agresti A., Booth J.G., Hobert J.P., Caffo B. Random-effects modeling of categorical response data. Sociological Methodology 2000, 30:27-80. doi: 10.1111/0081-1750.t01-1-00075.
2. Bakeman R. Recommended effect size statistics for repeated measures designs. Behavior Research Methods 2005, 37:379-384. doi: 10.3758/BF03192707.
3. Bauer D.J. Estimating multilevel linear models as structural equation models. Journal of Educational and Behavioral Statistics 2003, 28:135-167. doi: 10.3102/10769986028002135.
4. Bauer D.J. A note on comparing the estimates of models for cluster-correlated or longitudinal data with binary or ordinal outcomes. Psychometrika 2009, 74:97-105. doi: 10.1007/s11336-008-9080-1.
5. Bauer D.J., Cai L. Consequences of unmodeled nonlinear effects in multilevel models. Journal of Educational and Behavioral Statistics 2009, 34:97-114. doi: 10.3102/1076998607310504.
6. Bellamy S.L., Li Y., Lin X., Ryan L.M. Quantifying PQL bias in estimating cluster-level covariate effects in generalized linear mixed models for group-randomized trials. Statistica Sinica 2005, 15:1015-1032.
7. Bollen K.A. Structural equations with latent variables 1989, Wiley, New York, NY.
8. Breslow N.E., Clayton D.G. Approximate inference in generalized linear mixed models. Journal of the American Statistical Association 1993, 88:9-25. doi: 10.2307/2290687.
9. Breslow N.E., Lin X. Bias correction in generalised linear mixed models with a single component of dispersion. Biometrika 1995, 82:81-91. doi: 10.1093/biomet/82.1.81.
10. Chinn S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Statistics in Medicine 2000, 19:3127-3131. doi: 10.1002/1097-0258(20001130)19:22<3127::AID-SIM784>3.0.CO;2-M.
11. Curran P.J. Have multilevel models been structural equation models all along?. Multivariate Behavioral Research 2003, 38:529-569. doi: 10.1207/s15327906mbr3804_5.
12. Demidenko E. Mixed models: Theory and applications 2004, Wiley, Hoboken, NJ, doi: 10.1002/0471728438.
13. Goldstein H. Multilevel statistical models 2003, Arnold, London, England, Kendall's Library of Statistics No. 3. 3rd ed.
14. Goldstein H., Rasbash J. Improved approximations for multilevel models with binary responses. Journal of the Royal Statistical Society, Series A: Statistics in Society 1996, 159:505-513. doi: 10.2307/2983328.
15. Hedeker D., Gibbons R.D. Longitudinal data analysis 2006, Wiley, New York, NY.
16. Hox J. Multilevel analysis: Techniques and applications 2010, Routledge, New York, NY. 2nd ed.
17. Kaplan D. A study of the sampling variability and z values of parameter estimates from misspecified structural equation models. Multivariate Behavioral Research 1989, 24:41-57. doi: 10.1207/s15327906mbr2401_3.
18. Kendall M.G., Stuart A. The advanced theory of statistics 1969, Griffin, London, England.
19. Liang K.-Y., Zeger S.L. Longitudinal data analysis using generalized linear models. Biometrika 1986, 73:13-22. doi: 10.1093/biomet/73.1.13.
20. Liu I., Agresti A. The analysis of ordered categorical data: An overview and a survey of recent developments. Test 2005, 14:1-73. doi: 10.1007/BF02595397.
21. Long J.S. Regression models for categorical and limited dependent variables 1997, Sage, Thousand Oaks, CA.
22. McCullagh P., Nelder J.A. Generalized linear models 1989, Chapman & Hall, New York, NY.
23. McCulloch C.E. Maximum likelihood algorithms for generalized linear mixed models. Journal of the American Statistical Association 1997, 92:162-170. doi: 10.2307/2291460.
24. McCulloch C.E., Searle S.R., Neuhaus J.M. Generalized, linear, and mixed models 2008, Wiley, New York, NY.
25. Mehta P.D., Neale M.C. People are variables too: Multilevel structural equations modeling. Psychological Methods 2005, 10:259-284. doi: 10.1037/1082-989X.10.3.259.
26. Muthén L.K., Muthén B.O. Mplus statistical analysis with latent variables: User's guide 1998-2007, Authors, Los Angeles, CA.
27. Olejnik S., Algina J. Generalized eta and omega squared statistics: Measures of effect size for some common research designs. Psychological Methods 2003, 8:434-447. doi: 10.1037/1082-989X.8.4.434.
28. Rabe-Hesketh S., Skrondal A., Pickles A. Reliable estimation of generalized linear models using adaptive quadrature. The Stata Journal 2002, 2:1-21.
29. Raudenbush S.W., Bryk A.S. Hierarchical linear models: Applications and data analysis methods 2002, Sage, Newbury Park, CA. 2nd ed.
30. Raudenbush S.W., Yang M.-L., Yosef M. Maximum likelihood for generalized linear models with nested random effects via high-order, multivariate Laplace approximation. Journal of Computational and Graphical Statistics 2000, 9:141-157. doi: 10.2307/1390617.
31. Rodriguez G., Goldman N. An assessment of estimation procedures for multilevel models with binary responses. Journal of the Royal Statistical Society, Series A: Statistics in Society 1995, 158:73-89. doi: 10.2307/2983404.
32. Rodriguez G., Goldman N. Improved estimation procedures for multilevel models with binary response: A case study. Journal of the Royal Statistical Society, Series A: Statistics in Society 2001, 164:339-355. doi: 10.1111/1467-985X.00206.
33. Saei A., McGilchrist C.A. Longitudinal threshold models with random components. The Statistician 1998, 47:365-375. doi: 10.1111/1467-9884.00137.
34. Sankey S.S., Weissfeld L.A. A study of the effect of dichotomizing ordinal data upon modeling. Communications in Statistics-Simulation and Computation 1998, 27:871-887. doi: 10.1080/03610919808813515.
35. Skrondal A., Rabe-Hesketh S. Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models 2004, Chapman and Hall/CRC, New York, NY, doi: 10.1201/9780203489437.
36. Snijders T., Bosker R. Multilevel analysis: An introduction to basic and advanced multilevel modeling 1999, Sage, London, England.
37. Strömberg U. Collapsing ordered outcome categories: A note of concern. American Journal of Epidemiology 1996, 144:421-424.
38. Ten Have T.R., Localio A.R. Empirical Bayes estimation of random effects parameters in mixed effects logistic regression models. Biometrics 1999, 55:1022-1029. doi: 10.1111/j.0006-341X.1999.01022.x.
39. Winship C., Mare R.D. Regression models with ordinal variables. American Sociological Review 1984, 49:512-525. doi: 10.2307/2095465.
40. Yosef, M. (2001). A comparison of alternative approximations to maximum likelihood estimation for hierarchical generalized linear models: The logistic-normal model case (Unpublished doctoral dissertation). Michigan State University, East Lansing,.