Linear mixed models: A practical guide using statistical software

Linear Mixed Models: A Practical Guide Using Statistical Software

Volumn , Issue , 2022, Pages 1-490

  West, Brady T ^a   Welch, Kathy ^b   Galecki, Andrzej ^c   Gillespie, Brenda ^b  

^a Institute for Social Research   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

^c UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85152307467     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/9781003181064     Document Type: Book

References (120)

1. Airy, G. B. (1861). On the Algebraical and Numerical Theory of Errors of Observations and the Combination of Observations. Macmillan.
2. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In E. Petrov, & F. Csaki (Eds.) Second International Symposium on Information Theory and Control , (pp. 267-281). Akademiai Kiado.
3. Albert, A. (1976). When is a sum of squares an analysis of variance? The Annals of Statistics, 4(4), 775-778.
4. Allison, P. (2001). Missing Data: Quantitative Applications in the Social Sciences. Newbury Park, CA: Sage Publications.
5. Anderson, D., Oti, R., Lord, C., & Welch, K. (2009). Patterns of growth in adaptive social abilities among children with autism spectrum disorders. Journal of Abnormal Child Psychology , 37 (7), 1019-1034.
6. Anderson, R. L., & Bancroft, T. A. (1952). Statistical theory in research. Tech. rep.
7. Asparouhov, T. (2006). General multi-level modeling with sampling weights. Communications in Statistics, Theory and Methods, 35 (3), 439-460.
8. Asparouhov, T. (2008). Scaling of sampling weights for two-level models in Mplus 4.2. Available at http://www.statmodel.com/download/Scaling3.pdf .
9. Bottai, M., & Orsini, N. (2004). A new Stata command for estimating confidence intervals for the variance components of random-effects linear models. Presented at the United Kingdom Stata Users' Group Meetings.
10. Brown, H., & Prescott, R. (2006). Applied Mixed Models in Medicine. New York, NY: John Wiley and Sons, second ed.
11. Carle, A. (2009). Fitting multilevel models in complex survey data with design weights: Recommendations. BMC Medical Research Methodology , 9 (49), 1-13.
12. Carlin, B. P., & Louis, T. A. (2009). Bayesian Methods for Data Analysis. London: Chapman & Hall / CRC Press, third ed.
13. Casella, G., & Berger, R. (2002). Statistical Inference. North Scituate, MA: Duxbury Press.
14. Chauvenet, W. (1863). A manual of spherical and practical astronomy .
15. Claeskens, G. (2013). Lack of fit, graphics, and multilevel model diagnostics. In M. Scott, J. Simonoff, & B. Marx (Eds.) The Sage Handbook of Multilevel Modeling , (pp. 425-443). London: Sage Publications.
16. Cochran, W. G. (1939). The use of the analysis of variance in enumeration by sampling. Journal of the American Statistical Association, 34 (207), 492-510.
17. Cooper, D., & Thompson, R. (1977). A note on the estimation of the parameters of the autoregressive-moving average process. Biometrika, 64 (3), 625-628.
18. Crainiceanu, C., & Ruppert, D. (2004). Likelihood ratio tests in linear mixed models with one variance component. Journal of the Royal Statistical Society: Series B , 66 , 165-185.
19. Crump, S. L. (1946). The estimation of variance components in analysis of variance. Biometrics Bulletin, 2 (1), 7-11.
20. Davidian, M., & Giltinan, D. (1995). Nonlinear Models for Repeated Measurement Data. London: Chapman & Hall.
21. Dempster, A., Laird, N., & Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B , 39 (1), 1-38. With discussion.
22. Diggle, P. J., Heagerty, P. J., Liang, K.-Y., & Zeger, S. L. (2002). Analysis of longitudinal data, vol. 25 of Oxford Statistical Science Series. Oxford: Oxford University Press, second ed.
23. Douglas, C., Demarco, G., Baghdoyan, H., & Lydic, R. (2004). Pontine and basal forebrain cholinergic interaction: Implications for sheep and breathing. Respiratory Physiology and Neurobiology , 143 (2-3), 251-262.
24. Downes, M., & Carlin, J. B. (2020). Multilevel regression and poststratification versus survey sample weighting for estimating population quantities in large population health studies. American Journal of Epidemiology , 189 (7), 717-725.
25. Downes, M., Gurrin, L. C., English, D. R., Pirkis, J., Currier, D., Spittal, M. J., & Carlin, J. B. (2018). Multilevel regression and poststratification: A modeling approach to estimating population quantities from highly selected survey samples. American Journal of Epidemiology , 187 (8), 1780-1790.
26. Eisenhart, C. (1947). The assumptions underlying the analysis of variance. Biometrics, 3 (1), 1-21.
27. Enders, C. (2013). Centering predictors and contextual effects. In M. Scott, J. Simonoff, & B. Marx (Eds.) The Sage Handbook of Multilevel Modeling (pp. 89-107). London: Sage Publications.
28. Faraway, J. (2005). Linear Models with R. London: Chapman & Hall / CRC Press.
29. Fellner, W. (1987). Sparse matrices, and the estimation of variance components by likelihood equations. Communications in Statistics-Simulation, 16 (2), 439-463.
30. Fisher, R. (1925). Statistical methods for research workers.
31. Gabriel, K. (1962). Ante-dependence analysis of an ordered set of variables. The Annals of Mathematical Statistics (pp. 201-212).
32. Gal ecki, A. (1994). General class of covariance structures for two or more repeated factors in longitudinal data analysis. Communications in Statistics-Theory and Methods, 23 (11), 3105-3119.
33. Gal ecki, A., & Burzykowski, T. (2013). Linear Mixed-Effects Models using R: A Step-by-Step Approach. New York: Springer.
34. Ganguli, M. (1941). A note on nested sampling. Sankhya: The Indian Journal of Statistics (pp. 449-452).
35. Gao, F., Thompson, P., Xiong, C., & Miller, J. P. (2006). Analyzing multivariate longitudinal data using SAS. In Proceedings of the Thirty-first Annual SAS Users Group International Conference (pp. 187-31). Citeseer.
36. Geisser, S., & Greenhouse, S. (1958). An extension of Box's results on the use of the F distribution in multivariate analysis. The Annals of Mathematical Statistics, 29 (3), 885-891.
37. Gelman, A. (2007). Struggles with survey weighting and regression modeling. Statistical Science, 22 (2), 153-164.
38. Gelman, A., Carlin, J., Stern, H., & Rubin, D. (2004). Bayesian Data Analysis. London: Chapman and Hall / CRC Press.
39. Gelman, A., & Hill, J. (2006). Data Analysis using Regression and Multilevel / Hierarchical Models. New York: Cambridge University Press.
40. Goldstein, H. (1986). Multilevel mixed linear model analysis using iterative generalized least squares. Biometrika, 73 (1), 43-56.
41. Gregoire, T., Brillinger, D., Diggle, P., Russek-Cohen, E., Warren, W., & Wolfinger, R. (1997). Modeling Longitudinal and Spatially Correlated Data: Methods, Applications and Future Directions. New York, NY: Springer-Verlag.
42. Gurka, M. (2006). Selecting the best linear mixed model under REML. The American Statistician, 60 (1), 19-26.
43. Hartley, H. O., & Rao, J. N. (1967). Maximum-likelihood estimation for the mixed analysis of variance model. Biometrika, 54 (1-2), 93-108.
44. Harville, D. A. (1977). Maximum likelihood approaches to variance component estimation and to related problems. Journal of the American Statistical Association, 72 (358), 320- 340. With a comment by J. N. K. Rao and a reply by the author.
45. Headrick, T. C., & Zumbo, B. D. (2005). On optimizing multi-level designs: Power under budget constraints. Australian & New Zealand Journal of Statistics, 47 (2), 219-229.
46. Heeringa, S., West, B., & Berglund, P. (2017). Applied Survey Data Analysis. New York, NY: Chapman & Hall / CRC Press, second ed.
47. Helms, R. (1992). Intentionally incomplete longitudinal designs: 1. Methodology and comparison of some full span designs. Statistics in Medicine, 11 (14-15), 1889-1913.
48. Henderson, C. R. (1950). Estimation of genetic parameters. Annals of Mathematical Statistics, 21 , 309-210.
49. Henderson, C. R. (1953). Estimation of variance and covariance components. Biometrics, 9 (2), 226-252.
50. Hill, H.C., Rowan, B., and Ball, D.L. (2005). Effect of teachers' mathematical knowledge for teaching on student achievement. American Educational Research Journal, 42 (2), 371-406.
51. Huynh, H., & Feldt, L. (1976). Estimation of the box correction for degrees of freedom from sample data in the randomized block and split plot designs. Journal of Educational Statistics, 1 (1), 69-82.
52. Jackman, S. (2009). Bayesian Analysis for the Social Sciences. New York, NY: Wiley.
53. Jackson, R. (1939). Reliability of mental tests. British Journal of Psychology , 29 , 267-287.
54. Jennrich, R. I., & Schluchter, M. D. (1986). Unbalanced repeated-measures models with structured covariance matrices. Biometrics, 42 (4), 805-820.
55. Kennedy, L., & Gelman, A. (2021). Know your population and know your model: Using model-based regression and poststratification to generalize findings beyond the observed sample. Psychological Methods, 26(5), 547-558.
56. Kenward, M., & Roger, J. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53 (3), 983-997.
57. Khuri, A. I., & Sahai, H. (1985). Variance components analysis: A selective literature survey. International Statistical Review , 53(3), 279-300.
58. Korn, E., & Graubard, B. (1999). Analysis of Health Surveys. New York, NY: Wiley.
59. Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82 (13), 1-26.
60. Laird, N., Lange, N., & Stram, D. (1987). Maximum likelihood computations with repeated measures: Application of the EM algorithm. Journal of the American Statistical Association, 82 (397), 97-105.
61. Laird, N., & Ware, J. (1982). Random-effects models for longitudinal data. Biometrics, 38 (4), 963-974.
62. Lindley, D. V., & Smith, A. F. (1972). Bayes estimates for the linear model. Journal of the Royal Statistical Society: Series B (Methodological), 34 (1), 1-18.
63. Lindstrom, M. J., & Bates, D. M. (1988). Newton-Raphson and EM algorithms for linear mixed-effects models for repeated-measures data. Journal of the American Statistical Association, 83 (404), 1014-1022.
64. Little, R. J. A., & Rubin, D. B. (2019). Statistical Analysis with Missing Data. Wiley Series in Probability and Statistics. Hoboken, NJ: Wiley-Interscience [John Wiley & Sons], third ed.
65. Liu, C., & Rubin, D. B. (1994). The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika, 81(4), 633-648.
66. McCulloch, C. E., & Neuhaus, J. M. (2011). Misspecifying the shape of a random effects distribution: Why getting it wrong may not matter. Statistical Science, 26 (3), 388-402.
67. McCulloch, C.E., & Searle, S.R. (2001). Generalized, Linear, and Mixed Models. Wiley Series in Probability and Statistics. Hoboken, NJ: John Wiley & Sons.
68. Moerbeek, M., & Teerenstra, S. (2015). Power Analysis of Trials with Multilevel Data. CRC Press.
69. Molenberghs, G., & Verbeke, G. (2005). Models for Discrete Longitudinal Data. Berlin: Springer-Verlag.
70. Morrell, C. (1998). Likelihood ratio testing of variance components in the linear mixedeffects model using restricted maximum likelihood. Biometrics, 54 (4), 1560-1568.
71. Morrell, C., Pearson, J., & Brant, L. (1997). Linear transformations of linear mixed-effects models. The American Statistician, 51 (4), 338-343.
72. Nelder, J. (1977). A reformulation of linear models. Journal of the Royal Statistical Society, Series A, 140 (1), 48-77. C/R: pp. 63-76.
73. Neyman, J., Karolina, I., & St.Kolodziejczyk (1935). Statistical problems in agricultural experimentation. Supplement to the Journal of the Royal Statistical Society , 2 (2), 107- 180.
74. Ocampo, J. (2005). Effect of Porcelain Laminate Contour on Gingival Inflammation. Master's thesis, University of Michigan School of Dentistry.
75. Palardy, G. J. (2011). Review of HLM 7. Social Science Computer Review , 29 (4), 515-520.
76. Patterson, H. D., & Thompson, R. (1971). Recovery of inter-block information when block sizes are unequal. Biometrika, 58 , 545-554.
77. Pfeffermann, D., Skinner, C., Holmes, D., Goldstein, H., & Rasbash, J. (1998). Weighting for unequal selection probabilities in multilevel models. Journal of the Royal Statistical Society, Series B , 60 (1), 23-40.
78. Pinheiro, J., & Bates, D. (1996). Unconstrained parameterizations for variance-covariance matrices. Statistics and Computing , 6 , 289-296.
79. Pinheiro, J., & Bates, D. (2000). Mixed-effects Models in S and S-PLUS. Berlin: SpringerVerlag.
80. Rabe-Hesketh, S., & Skrondal, A. (2006). Multilevel modeling of complex survey data. Journal of the Royal Statistical Society, Series A, 169 , 805-827.
81. Rao, C. (1972a). Estimation of variance of covariance components in linear models. Journal of the American Statistical Association, 67 (337), 112-115.
82. Rao, C. R. (1965). The theory of least squares when the parameters are stochastic and its application to the analysis of growth curves. Biometrika, 52 (3/4), 447-458.
83. Rao, C. R. (1972b). Estimation of variance and covariance components in linear models. Journal of the American Statistical Association, 67 (337), 112-115.
84. Raudenbush, S., & Bryk, A. (2002). Hierarchical Linear Models: Applications and Data Analysis Methods. Newbury Park, CA: Sage Publications.
85. Raudenbush, S., Bryk, A., & Congdon, R. (2005). HLM 6: Hierarchical Linear and Nonlinear Modeling. Lincolnwood, IL: Scientific Software International.
86. Robinson, G. (1991). That blup is a good thing: The estimation of random effects. Statistical Science, 6 (1), 15-32. Discussion: pp. 32-51.
87. SAS. (1992). SAS Technical Report P229, SAS/STAT Software: Changes and Enhancements, Release 6.07. SAS Institute Inc., Cary, NC.
88. Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2 (6), 110-114.
89. Schabenberger, O. (2004). Mixed model influence diagnostics. Proceedings of the TwentyNinth Annual SAS Users Group International Conference. Paper 189-29.
90. Scheffe, H. (1956). Alternative models for the analysis of variance. The Annals of Mathematical Statistics, 27 (2), 251-271.
91. Scheipl, F., Greven, S., & Kuechenhoff, H. (2008). Size and power of tests for a zero random effect variance or polynomial regression in additive and linear mixed models. Computational Statistics & Data Analysis, 52 (7), 3283-3299.
92. Schluchter, M. (1988). Unbalanced Repeated Measures Models with Structured Covariance Matrices. BMDP Statistical Software Manual. University of California Press, Berkeley.
93. Scott, M. A., Simonoff, J. S., & Marx, B. D. (2013). The SAGE Handbook of Multilevel Modeling. Sage.
94. Searle, S., Casella, G., & McCulloch, C. (1992). Variance Components. New York: John Wiley.
95. Searle, S. R., Casella, G., & McCulloch, C. E. (2009). Variance Components, vol. 391. New York: John Wiley & Sons.
96. Self, S. G., & Liang, K.-Y. (1987). Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions. Journal of the American Statistical Association, 82 (398), 605-610.
97. Smith, D. W., & Murray, L. W. (1984). An alternative to Eisenhart's model II and mixed model in the case of negative variance estimates. Journal of the American Statistical Association, 79 (385), 145-151.
98. Snijders, T., & Bosker, R. (1999). Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. Newbury Park, CA: Sage Publications.
99. Spybrook, J., Bloom, H., Congdon, R., Hill, C., Martinez, A., & Raudenbush, S. (2011). Optimal design plus empirical evidence: Documentation for the "optimal design" software version 3.0. Available from http://www.hlmsoft.net/od/ .
100. Steele, R. (2013). Model selection for multilevel models. In M. Scott, J. Simonoff, & B. Marx (Eds.) The Sage Handbook of Multilevel Modeling (pp. 109-125). London: Sage Publications.
101. Stram, D., & Lee, J. (1994). Variance components testing in the longitudinal mixed effects model. Biometrics, 50 (4), 1171-1177.
102. Tippett, L. H. C., et al. (1931). The Methods of Statistics: An Introduction Mainly for Workers in the Biologica Sciences. Williams and Norgate, Ltd., London.
103. Townsend, E. C., & Searle, S. R. (1971). Best quadratic unbiased estimation of variance components from unbalanced data in the 1-way classification. Biometrics, 27(3), 643-657.
104. Valliant, R., Dever, J., & Kreuter, F. (2018). Practical Tools for Designing and Weighting Survey Samples. New York: Springer, second ed.
105. van Breukelen, G., & Moerbeek, M. (2013). Design considerations in multilevel studies. In M. Scott, J. Simonoff, & B. Marx (Eds.) The Sage Handbook of Multilevel Modeling (pp. 183-199). London: Sage Publications.
106. Veiga, A., Smith, P., & Brown, J. (2014). The use of sample weights in multivariate multilevel models with an application to income data collected using a rotating panel survey. Journal of the Royal Statistical Society, Series C (Applied Statistics), 63 (1), 65-84.
107. Verbeke, G., & Molenberghs, G. (2000). Linear Mixed Models for Longitudinal Data. Springer-Verlag.
108. Verbyla, A. (1990). A conditional derivation of residual maximum likelihood. The Australian Journal of Statistics, 32 (2), 227-230.
109. Verbyla, A., & Cullis, B. R. (1990). Modelling in repeated measures experiments. Journal of the Royal Statistical Society: Series C (Applied Statistics), 39 (3), 341-356.
110. Wald, A. (1940). A note on the analysis of variance with unequal class frequencies. The Annals of Mathematical Statistics, 11 (1), 96-100.
111. Waterman, M. J., Birch, J. B., & Abdel-Salam, A.-S. G. (2015). Several nonparametric and semiparametric approaches to linear mixed model regression. Journal of Statistical Computation and Simulation, 85 (5), 956-977.
112. West, B. T., & Elliott, M. R. (2014). Frequentist and Bayesian approaches for comparing interviewer variance components in two groups of survey interviewers. Survey Methodology , 40 (2), 163-188.
113. West, B. T. (2017). Book review: Power analysis of trials with multilevel data. Biometrical Journal , 59 (6), 1399-1401.
114. West, B. T., Conrad, F. G., Kreuter, F., & Mittereder, F. (2018a). Can conversational interviewing improve survey response quality without increasing interviewer effects? Journal of the Royal Statistical Society: Series A (Statistics in Society), 181 (1), 181-203.
115. West, B. T., Conrad, F. G., Kreuter, F., & Mittereder, F. (2018b). Nonresponse and measurement error variance among interviewers in standardized and conversational interviewing. Journal of Survey Statistics and Methodology , 6 (3), 335-359.
116. West, B. T., & Gal ecki, A. T. (2011). An overview of current software procedures for fitting linear mixed models. The American Statistician, 65 (4), 274-282.
117. Winer, B., Brown, D., & Michels, K. (1991). Statistical Principles in Experimental Design. New York: McGraw-Hill.
118. Winsor, C., & Clarke, G. (1940). A statistical study of variation in the catch of plankton nets. Journal of Marine Research, 3 (1), 1-34.
119. Yates, F. (1940). The recovery of inter-block information in balanced incomplete block designs. Annals of Eugenics, 10 (1), 317-325.
120. Yule, G. U. (1927). On a method of investigating periodicities disturbed series, with special reference to Wolfer's sunspot numbers. Philosophical Transactions of the Royal Society of London. Series A, 226 (636-646), 267-298.