Prediction in multilevel generalized linear models

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 172, Issue 3, 2009, Pages 659-687

  Skrondal, Anders ^a   Rabe Hesketh, Sophia ^b,c  

^a NORWEGIAN INSTITUTE OF PUBLIC HEALTH   (Norway)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Adaptive quadrature; Best linear unbiased predictor (BLUP); Comparative standard error; Diagnostic standard error; Empirical Bayes; Generalized linear mixed model; Gllamm; Mean squared error of prediction; Multilevel model; Posterior; Prediction; Random effects

Indexed keywords

EID: 65649115103     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2009.00587.x     Document Type: Article

References (94)

1. Adams, R. (2002) Scaling PISA cognitive data. In PISA 2000 Technical Report (eds R. Adams M. Wu pp. 99 108. Paris : Organisation for Economic Co-operation and Development.
2. Afshartous, D. de Leeuw, J. (2005) Prediction in multilevel models. J. Educ. Behav. Statist., 30, 109 139.
3. Afshartous, D. Wolf, M. (2007) Avoiding 'data snooping' in multilevel and mixed effects models. J. R. Statist. Soc. A, 170, 1035 1059.
4. Bartlett, M. S. (1938) Methods of estimating mental factors. Nature, 141, 609 610.
5. Bernardo, J. M. Smith, A. F. M. (1994) Bayesian Theory. New York : Wiley.
6. Bock, R. D. Aitkin, M. (1981) Marginal maximum likelihood estimation of item parameters: application of an EM algorithm. Psychometrika, 46, 443 459.
7. Bock, R. D. Mislevy, R. J. (1982) Adaptive EAP estimation of ability in a microcomputer environment. Appl. Psychol. Measmnt, 6, 431 444.
8. Bondeson, J. (1990) Prediction in random coefficient regression models. Biometr. J., 32, 387 405.
9. Booth, J. G. Hobert, J. P. (1998) Standard errors of prediction in generalized linear mixed models. J. Am. Statist. Ass., 93, 262 272.
10. Breslow, N. E. Clayton, D. G. (1993) Approximate inference in generalized linear mixed models. J. Am. Statist. Ass., 88, 9 25.
11. Candel, M. J. J. M. (2004) Performance of empirical bayes estimators of random coefficients in multilevel analysis: some results for the random intercept-only model. Statist. Neerland., 58, 197 219.
12. Candel, M. J. J. M. (2007) Empirical bayes estimators of the random intercept in multilevel analysis: performance of the classical, Morris and Rao version. Computnl Statist. Data Anal., 51, 3027 3040.
13. Carlin, B. P. Louis, T. A. (2000a) Bayes and Empirical Bayes Methods for Data Analysis, 2nd edn. Boca Raton : Chapman and Hall-CRC.
14. Carlin, B. P. Louis, T. A. (2000b) Empirical Bayes: past, present and future. J. Am. Statist. Ass., 95, 1286 1289.
15. Chamberlain, G. (1984) Panel data. In Handbook of Econometrics, vol. II (eds Z. Griliches M. D. Intriligator pp. 1247 1318. Amsterdam : North-Holland.
16. Chang, H. Stout, W. (1993) The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika, 58, 37 52.
17. Clayton, D. G. (1996) Generalized linear mixed models. In Markov Chain Monte Carlo in Practice (eds W. R. Gilks, S. Richardson D. J. Spiegelhalter pp. 275 301. London : Chapman and Hall.
18. Clayton, D. G. Kaldor, J. (1987) Empirical Bayes estimates of age-standardized relative risks for use in disease mapping. Biometrics, 43, 671 681.
19. Deely, J. J. Lindley, D. V. (1981) Bayes empirical Bayes. J. Am. Statist. Ass., 76, 833 841.
20. Demidenko, E. (2004) Mixed Models: Theory and Applications. New York : Wiley.
21. Duchateau, L. Janssen, P. (2005) Understanding heterogeneity in mixed, generalized mixed and frailty models. Am. Statistn, 59, 143 146.
22. Efron, B. Morris, C. (1973) Stein's estimation rule and its competitors - an empirical Bayes approach. J. Am. Statist. Ass., 68, 117 130.
23. Efron, B. Morris, C. (1975) Data analysis using Stein's estimator and its generalizations. J. Am. Statist. Ass., 70, 311 319.
24. Embretson, S. E. Reise, S. P. (2000) Item Response Theory for Psychologists. Mahwah : Erlbaum.
25. Farrell, P. J., MacGibbon, B. Tomberlin, T. J. (1997) Bootstrap adjustments for empirical Bayes interval estimates of small-area proportions. Can. J. Statist., 25, 75 89.
26. Fearn, T. (1975) A Bayesian approach to growth curves. Biometrika, 62, 89 100.
27. Frees, E. W. Kim, J.-S. (2006) Multilevel model prediction. Psychometrika, 71, 79 104.
28. Ganzeboom, H. G. B., De Graaf, P., Treiman, D. J. de Leeuw, J. (1992) A standard international socio-economic index of occupational status. Socl Sci. Res., 21, 1 56.
29. Gibbons, R. D., Hedeker, D., Charles, S. C. Frisch, P. (1994) A random-effects probit model for predicting medical malpractice claims. J. Am. Statist. Ass., 89, 760 767.
30. Goldberger, A. S. (1962) Best linear unbiased prediction in the generalized linear regression model. J. Am. Statist. Ass., 57, 369 375.
31. Goldstein, H. (1995) Multilevel Statistical Models, 2nd edn. London : Arnold.
32. Goldstein, H. (2003) Multilevel Statistical Models, 3rd edn. London : Arnold.
33. Goldstein, H. Spiegelhalter, D. J. (1996) League tables and their limitations: statistical issues in comparisons of institutional performance. J. R. Statist. Soc. A, 159, 385 409.
34. Hall, P. Maiti, T. (2006). J. R. Statist. Soc. B, 68, 221 238.
35. Harville, D. A. (1976) Extension of the Gauss-Markov theorem to include the estimation of random effects. Ann. Statist., 2, 384 395.
36. Hoijtink, H. Boomsma, A. (1995) On person parameter estimation in the dichotomous Rasch model. In Rasch Models: Foundations, Recent Developments, and Applications (eds G. H. Fischer I. W. Molenaar pp. 53 68. New York : Springer.
37. Jiang, J. (2007) Linear and Generalized Linear Mixed Models and Their Applications. New York : Springer.
38. Jiang, J. Lahiri, P. (2001) Empirical best prediction for small area inference with binary data. Ann. Inst. Statist. Math., 53, 217 243.
39. Kackar, R. N. Harville, D. A. (1984) Approximations for standard errors of estimators of fixed and random effects in mixed linear models. J. Am. Statist. Ass., 79, 853 862.
40. Kass, R. E. Steffey, D. (1989) Approximate Bayesian inference in conditionally independent hierarchical models (parametric empirical Bayes models). J. Am. Statist. Ass., 84, 717 726.
41. Laird, N. M. Louis, T. A. (1987) Empirical Bayes confidence intervals based on bootstrap samples (with discussion). J. Am. Statist. Ass., 82, 739 757.
42. Laird, N. M. Ware, J. H. (1982) Random effects models for longitudinal data. Biometrics, 38, 963 974.
43. Lange, N. Ryan, L. M. (1989) Assessing normality in random effects models. Ann. Statist., 17, 624 642.
44. Langford, I. H. Lewis, T. (1998) Outliers in multilevel data (with discussion). J. R. Statist. Soc. A, 161, 121 160.
45. Lawley, D. N. Maxwell, A. E. (1971) Factor Analysis as a Statistical Method. London : Butterworth.
46. Lindley, D. V. Smith, A. F. M. (1972) Bayes estimates for the linear model (with discussion). J. R. Statist. Soc. B, 34, 1 41.
47. Longford, N. T. (2001) Simulation-based diagnostics in random-coefficient models. J. R. Statist. Soc. A, 164, 259 273.
48. Louis, T. A. (1984) Bayes and empirical Bayes estimates of a population of parameter values. J. Am. Statist. Ass., 79, 393 398.
49. Ma, X., Ma, L. Bradley, K. D. (2008) Using multilevel modeling to investigate school effects. In Multilevel Modelling of Educational Data (eds A. A. O'Connell D. B. McCoach pp. 59 110. Charlotte : Information Age Publishing.
50. Maritz, J. S. Lwin, T. (1989) Empirical Bayes Methods. London : Chapman and Hall.
51. McCulloch, C. E. (1997) Maximum likelihood algorithms for generalized linear mixed models. J. Am. Statist. Ass., 92, 162 170.
52. McCulloch, C. E. Neuhaus, J. (2007) Prediction of random effects and effects of misspecification of their distribution. West Coast Stata Users Group Meet., Marina Del Rey. (Available from http://repec.org/wcsug2007/12.html.)
53. McCulloch, C. E., Searle, S. R. Neuhaus, J. M. (2008) Generalized, Linear and Mixed Models, 2nd edn. New York : Wiley.
54. Mislevy, R. J. (1986) Recent developments in the factor analysis of categorical variables. J. Educ. Statist., 11, 3 31.
55. Morris, C. (1983) Parametric empirical Bayes inference: theory and applications. J. Am. Statist. Ass., 78, 47 65.
56. Organisation for Economic Co-operation and Development (2000) Manual for the PISA 2000 Database. Paris : Organisation for Economic Co-operation and Development Available from http://www.pisa.oecd.org/dataoecd/53/18/33688135.
57. Bates, D. M. (1995) Approximations to the log-likelihood function in the nonlinear mixed-effects model. J. Computnl Graph. Statist., 4, 12 35.
58. Rabe-Hesketh, S., Pickles, A. Skrondal, A. (2003) Correcting for covariate measurement error in logistic regression using nonparametric maximum likelihood estimation. Statist. Modllng, 3, 215 232.
59. Rabe-Hesketh, S. Skrondal, A. (2006) Multilevel modelling of complex survey data. J. R. Statist. Soc. A, 169, 805 827.
60. Rabe-Hesketh, S. Skrondal, A. (2008a) Generalized linear mixed effects models. In Longitudinal Data Analysis (eds G. M. Fitzmaurice, M. Davidian, G. Verbeke G. Molenberghs pp. 79 106. Boca Raton : Chapman and Hall-CRC.
61. Rabe-Hesketh, S. Skrondal, A. (2008b) Multilevel and Longitudinal Modeling using Stata, 2nd edn. College Station : Stata Press.
62. Rabe-Hesketh, S., Skrondal, A. Pickles, A. (2004) Generalized multilevel structural equation modeling. Psychometrika, 69, 167 190.
63. Rabe-Hesketh, S., Skrondal, A. Pickles, A. (2005) Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects. J. Econometr., 128, 301 323.
64. Rao, C. R. (1975) Simultaneous estimation of parameters in different linear models and applications to biometric problems. Biometrics, 31, 545 554.
65. Rao, J. N. K. (2003) Small Area Estimation. New York : Wiley.
66. Raudenbush, S. W. Bryk, A. S. (2002) Hierarchical Linear Models. Thousand Oaks : Sage.
67. Raudenbush, S. W. Willms, J. D. (1995) Estimation of school effects. J. Educ. Behav. Statist., 20, 307 335.
68. Reinsel, G. C. (1984) Estimation and prediction in a multivariate random effects generalized linear model. J. Am. Statist. Ass., 79, 406 414.
69. Reinsel, G. C. (1985) Mean squared error properties of empirical Bayes estimators in a multivariate random effects general linear model. J. Am. Statist. Ass., 80, 642 650.
70. Robbins, H. (1955) An empirical Bayes approach to statistics. In Proc. 3rd Berkeley Symp. Mathematical Statistics and Probability (ed. J. Neyman pp. 157 164. Berkeley : University of California Press.
71. Robinson, G. K. (1991) That BLUP is a good thing: the estimation of random effects. Statist. Sci., 6, 15 51.
72. Rose, C. E., Hall, D. B., Shiver, B. D., Clutter, M. L. Borders, B. (2006) A multilevel approach to individual tree survival prediction. For. Sci., 52, 31 43.
73. Rosenberg, B. (1973) Linear regression with randomly dispersed parameters. Biometrika, 60, 65 72.
74. Rubin, D. B. (1980) Using empirical Bayes techniques in the law school validity studies. J. Am. Statist. Ass., 75, 801 827.
75. Rubin, D. B. (1984) Bayesianly justifiable and relevant frequency calculations for the applied statistician. Ann. Statist., 12, 1151 1172.
76. Rumberger, R. W. Palardy, G. J. (2005) Does segregation still matter? The impact of student composition on academic achievement in high school. Teach. Coll. Rec., 107, 1999 2045.
77. Schilling, S. G. Bock, R. D. (2005) High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature. Psychometrika, 70, 533 555.
78. Searle, S. R., Casella, G. McCulloch, C. E. (1992) Variance Components. New York : Wiley.
79. Skrondal, A. (1996) Latent Trait, Multilevel and Repeated Measurement Modelling with Incomplete Data of Mixed Measurement Levels. Oslo :.
80. Skrondal, A. Rabe-Hesketh, S. (2004) Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models. Boca Raton : Chapman and Hall-CRC.
81. Skrondal, A. Rabe-Hesketh, S. (2007a) Redundant overdispersion parameters in multilevel models. J. Educ. Behav. Statist., 32, 419 430.
82. Skrondal, A. Rabe-Hesketh, S. (2007b) Latent variable modelling: a survey. Scand. J. Statist., 34, 712 745.
83. Smith, A. F. M. (1973) A general Bayesian linear model. J. R. Statist. Soc. B, 35, 67 75.
84. Strenio, J. L. F., Weisberg, H. I. Bryk, A. S. (1983) Empirical Bayes estimation of individual growth curve parameters and their relations to covariates. Biometrics, 39, 71 86.
85. Swamy, P. A. V. B. (1970) Efficient inference in a random coefficient regression model. Econometrica, 38, 311 323.
86. Ten Have, T. R. Localio, A. R. (1999) Empirical Bayes estimation of random effects parameters in mixed effects logistic regression models. Biometrics, 55, 1022 1029.
87. Thomson, G. H. (1938) The Factorial Analysis of Human Ability. London : University of London Press.
88. Thurstone, L. L. (1935) The Vectors of Mind. Chicago : University of Chicago Press.
89. Tsutakawa, R. K. Johnson, J. C. (1990) The effect of uncertainty of item parameter estimation on ability estimates. Psychometrika, 55, 371 390.
90. Vidoni, P. (2006) Response prediction in mixed effects models. J. Statist. Planng Inf., 136, 3948 3966.
91. Vonesh, E. F. Chinchilli, V. M. (1997) Linear and Nonlinear Models for the Analysis of Repeated Measurements. New York : Dekker.
92. Ware, J. H. Wu, M. C. (1981) Tracking: prediction of future values from serial measurements. Biometrics, 37, 427 437.
93. Warm, T. A. (1989) Weighted likelihood estimation of ability in item response models. Psychometrika, 54, 427 450.
94. Willms, J. D. (1986) Social class segregation and its relationship to pupils' examination results in Scotland. Am. Sociol. Rev., 51, 224 241.