Generalized linear mixed models for ordered responses in complex multilevel structures: Effects beneath the school or college in education

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 168, Issue 1, 2005, Pages 159-183

  Fielding, Antony ^a   Yang, Min ^b  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Cross classified random effects; Educational effects; Extra multinomial variation; General Certificate of Education advanced level; Multilevel models; Ordinal responses; Penalized quasi likelihood; Teacher variation; Weighted random effects

Indexed keywords

EID: 12844250111     PISSN: 09641998     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2004.00342.x     Document Type: Review

References (96)

1. Aitkin, M. (1999) A general maximum likelihood analysis of variance component in generalised linear models. Biometrics, 55, 117-128.
2. Aitkin, M. and Longford, N. T. (1986) Statistical modelling issues in school effectiveness studies (with discussion). J. R. Statist. Soc. A, 149, 1-42.
3. Albert, J. and Chib, S. (1993) Bayesian analysis of binary and polychotomous response data. J. Am. Statist. Ass., 88, 669-679.
4. Anderson, D. A. and Aitkin, M. (1985) Variance component models with binary response: interviewer variability. J. R. Statist. Soc. B, 47, 203-210.
5. Belfield, C., Fielding, A. and Thomas, H. (1996a) Costs and performance of A-level provision in schools. Research Report. School of Education, University of Birmingham, Birmingham.
6. Belfield, C., Fielding, A. and Thomas, H. (1996b) Costs and performance of A level provision in colleges. Research Report. School of Education, University of Birmingham, Birmingham.
7. Breslow, N. E. and Clayton, D. J. (1995) Approximate inference in generalised linear models. J. Am. Statist. Ass., 88, 9-25.
8. Browne, W. J. (2003) MCMC Estimation in MLwiN. London: Institute of Education.
9. Browne, W. J., Goldstein, H. and Rasbash, J. (2001) Multiple membership multiple classification (MCMC) models. Statist. Modllng, 1, 103-124.
10. Browne, W. J., Subramanian, S. V., Jones, K. and Goldstein, H. (2002) Variance Partitioning in Multilevel Logistic Models that Exhibit Overdispersion. London: Institute of Education.
11. Bryk, A. S. and Raudenbush, S. W. (1992) Hierarchical Linear Models. Newbury Park: Sage.
12. Card, D. and Krueger, A. B. (1992) Does school quality matter?: returns to education and characteristics of public schools in the US. J. Polit. Econ., 100, 1-40.
13. Clayton, D. and Rasbash, J. (1999) Estimation in large crossed random-effects models by data augmentation. J. R Statist. Soc. A, 162, 425-436.
14. Coe, R. and Fitz-Gibbon, C. T. (1998) School effectiveness research: criticisms and recommendations. Oxf. Rev. Educ., 24, 421-438.
15. Department of Education and Science (1995) GCSE to GCE A/S Value Added. London: Her Majesty's Stationery Office.
16. Diamond, I., Clements, S., Stone, N. and Ingham, R. (1999) Spatial variation in teenage conceptions in south and west England. J. R. Statist. Soc. A, 162, 273-289.
17. Ezzett, F. and Whitehead, J. (1991) A random effects model for ordinal responses from a crossover trial. Statist. Med., 10, 901-907.
18. Fielding, A. (1997) On scoring ordered classifications. Br. J. Math. Statist. Psychol., 50, 285-307.
19. Fielding, A. (1999) Why use arbitrary points scores?: ordered categories in models of educational progress. J. R. Statist. Soc. A, 162, 303-328.
20. Fielding, A. (2000) Scores and categories for ordinal responses in multilevel and weighted random effects models. Discussion Paper 00-02. Department of Economics, University of Birmingham, Birmingham.
21. Fielding, A. (2001) Scaling variance components for ordinal multilevel models. In New Trends in Statistical Modelling: Proc. 16th Int. Wrkshp Statistical Modelling (eds B. Klein and L. Korsholm). Odense: University of Southern Denmark.
22. Fielding, A. (2002a) Teaching groups as foci for evaluating performance in cost-effectiveness of GCE advanced level provision: some practical methodological innovations. School Effectiv. School Improvmnt, 13, 225-246.
23. Fielding, A. (2002b) Ordered category responses and random effects in multilevel and other complex structures: scored and generalised models. In Multilevel Modelling: Methodological Advances, Issues and Application (eds N. Duan and S. Reise), ch. 8, pp. 181-208. New York: Erlbaum.
24. Fielding, A. and Yang, M. (1999) Random effects models for multilevel and complex structures with ordered category responses. Discussion Paper 99-20. Department of Economics, University of Birmingham, Birmingham.
25. Fielding, A., Yang, M. and Goldstein, H. (2003) Multilevel models for ordinal grades. Statist. Modllng, 3, 127-153.
26. Figlio, D. N. (1999) Functional form and the estimated effects of school resources. Econ. Educ. Rev., 18, 241-252.
27. Fitz-Gibbon, C. T. (1996) Monitoring Education: Indicators, Quality and Effectiveness. London: Cassell.
28. Fitz-Gibbon, C. T. (1997) The Value Added National Project: Final Report. London: Schools Curriculum and Assessment Authority.
29. Fitz-Gibbon, C. T. and Vincent, L. (1997) Difficulties regarding subject difficulties: developing reasonable explanations for observable data. Oxf. Rev. Educ., 23, 291-298.
30. Fitzmaurice, G. M., Heath, A. F. and Cox, D. R. (1997) Detecting Overdispersion in large scale surveys: application to a study of education and social class in Britain (with comments). Appl. Statist., 46, 415-432.
31. Fräser, B. J. and Tobin, K. (1989) Students perception of psycho-social environment in classroooms of exemplary science teachers. Int. J. Sci. Educ., 11, 19-34.
32. Gibbons, R. D. and Hedeker, D. (1997) Random effects probit and logistic regressions for three level data. Biometrics, 53, 1527-1537.
33. Goldstein, H. (1986) Multilevel mixed linear model analysis using iterative generalised least squares. Biometrika, 73, 43-56.
34. Goldstein, H. (1987) Multilevel covariance component models. Biometrika, 74, 430-431.
35. Goldstein, H. (1991) Nonlinear multilevel models, with an application in discrete response data. Biometrika, 8, 45-51.
36. Goldstein, H. (1995) Multilevel Statistical Models, 2nd edn. London: Arnold.
37. Goldstein, H. (1996) Consistent estimators for multilevel generalised linear models using an iterated bootstrap. Multilev. Modllng Newslett., 8, no. 1, 3-6.
38. Goldstein, H. (2003) Multilevel Statistical Models, 3rd edn. London: Arnold.
39. Goldstein, H., Browne, W. J. and Rasbash, J. (2002) Partitioning variation in multilevel models. Understand. Statist., 1, 223-232.
40. Goldstein, H. and Cresswell, M. (1996) The comparability of different subjects in public examinations: a theoretical and practical critique. Oxf. Rev. Educ., 22, 435-442.
41. Goldstein, H. and Rasbash, J. (1992) Efficient computational procedures for estimation of parameters in multilevel models based on iterative generalised least squares. Comput. Statist. Data Anal., 13, 63-71.
42. Goldstein, H. and Rasbash, J. (1996) Improved approximations for multilevel models with binary responses. J. R. Statist. Soc. A, 159, 505-513.
43. Goldstein, H. and Sammons, P. (1997) The influence of secondary and junior schools on sixteen year examination performance: a cross-classified multilevel analysis. School Effectiv. School Improvmnt, 8, 219-230.
44. Goldstein, H. and Spiegelhalter, D. J. (1996) League tables and their limitations: statistical issues in comparisons of institutional performance. J. R. Statist. Soc. A, 159, 385-409.
45. Goldstein, H. and Thomas, S. (1996) Using examination results as indicators of school and college performance. J. R. Statist. Soc. A, 159, 149-163.
46. Gray, J., Allnut, D., Gardner, J., Blackham, C. and Frost, B. (1995) Technical Annex to GCE A/AS Value Added Briefing for Schools and Colleges. London: Department for Education and Employment.
47. Gray, J., Jesson, D., Goldstein, H., Hedger, K. and Rasbash, J. (1995) The statistics of school improvement: establishing the agenda. In Good School. Bad School: Evaluating Performance and Encouraging Improvement (eds J. Gray and B. Wilcox). Buckingham: Open University Press.
48. Greene, W. H. (2002) Econometric Analysis, 5th edn. New York: Prentice Hall.
49. Hanushek, E. A. (1986) The economics of schooling: production efficiency in public schools. J. Econ. Lit., 24, 1141-1177.
50. Harville, D. A. and Mee, R. W. (1984) A mixed-model procedure for analysing ordered categorical data. Biometrics, 40, 393-408.
51. Hedeker, D. and Gibbons, R. D. (1994) A random-effects ordinal regression model for multilevel analysis. Biometrics, 50, 933-944.
52. Hedeker, D. and Gibbons, R. D. (1996) MIXOR: a computer program for mixed effects ordinal regression analysis. Comput. Meth. Programs Biomed., 49, 157-176.
53. Hedeker, D. and Mermelstein, R. D. (1998) A multilevel thresholds of change model for analysis of stages of change data. Multiv. Behav. Res., 33, 427-455.
54. Hill, P. W. and Goldstein, H. (1998) Multilevel modelling of educational data with cross-classification and missing identification for units. J. Educ. Behav. Statist., 23, 117-128.
55. Hill, P. W. and Rowe, K. J. (1996) Multilevel models in school effectiveness research. School Effectiv. School Improvmnt, 7, 1-33.
56. Hill, P. W. and Rowe, K. J. (1998) Modelling student progress in studies of educational effectiveness. School Effectiv. School Improvmnt, 9, 310-333.
57. Jansen, J. (1990) On the statistical analysis of ordinal data when extravariation is present. Appl. Statist., 39, 75-84.
58. Kuk, A. Y. C. (1995) Asymptotically unbiased estimation in generalized linear models with random effects. J. R. Statist. Soc. B, 57, 395-407.
59. Lee, Y. and Nelder, J. A. (2001) Hierarchical generalised linear models: a synthesis of generalised linear models, random effects models, and structured dispersion. Biometrika, 88, 987-1006.
60. Leyland, A. H. and Goldstein, H. (eds) (2001) Multilevel Modelling of Health Statistics. London: Wiley.
61. Lindley, D. V. and Smith, A. F. M. (1972) Bayes estimates for the linear model (with discussion). J. R. Statist. Soc. B, 34, 1-41.
62. Long, J. S. (1997) Regression Models for Categorical and Limited Dependent Variables. Thousand Oaks: Sage.
63. Longford, N. T. (1993) Random Coefficient Models. Oxford: Oxford University Press.
64. Luyten, H. and de Jong, R. (1998) Parallel classes: differences and similarities. Teacher effects and school effects in secondary schools. School Effectiv. School Improvmnt, 9, 437-473.
65. McCullagh, P. and Nelder, J. A. (1989) Generalized Linear Models, 2nd edn. London: Chapman and Hall.
66. McCulloch, C. E. (1999) An introduction to generalised linear mixed models. In Statistical Modelling: Proc. 14th Int. Wrkshp Statistical Modelling (eds H. Friedl, A. Berghold and G. Kauerman). Graz: Technical University of Graz.
67. McCulloch, C. E. and Searle, S. R. (2000) Generalised. Linear and Mixed Models. New York: Wiley.
68. Monk, D. H. (1992) Education productivity research: an update and assessment of its role in education finance reform. Educ. Evaln Poly Anal., 14, 307-332.
69. Newton, P. E. (1997) Measuring comparability of standard between subjects: why our statistical techniques do not make the grade. Br. Educ. Res. J., 23, 433-449.
70. Nuttall, D. L., Goldstein, H., Prosser, R. and Rasbash, J. (1989) Differential school effectiveness. Int. J. Educ. Res., 13, 769-776.
71. O'Donoghue, C., Thomas, S., Goldstein, H. and Knight, T. (1997) 1996 DfEE Study of Value Added for 16-18 Year Olds in England. London: Department for Education and Employment.
72. O'Muircheartaigh, C. and Campanelli, P. (1998) The relative impact of interviewer effects and sample design effects on survey precision. J. R. Statist. Soc. A, 161, 63-77.
73. Pan, J.-X. and Thompson, R. (2000) Generalised linear mixed models: an improved estimation procedure. In COMPSTAT (2000): Proc. Computational Statistics (eds J. G. Bethlehem and P. G. M. van der Heijden), pp. 373-378. Heidelberg: Physica.
74. Rabe-Hesketh, S., Skrondal, A. and Pickles, A. (2002) Reliable estimation of generalised linear mixed models using adaptive quadrature. Stata J., 2, 1-21.
75. Rasbash, J., Browne, W., Goldstein, H., Yang, M., Plewis, I., Healy, M., Woodhouse, G., Draper, D., Langford, I. and Lewis, T. (2000) A User's Guide to MLwiN, Version 2.1. London: Institute of Education.
76. Rasbash, J. and Goldstein, H. (1994) Efficient analysis of mixed hierarchical and cross-classified random structures using a multilevel model. J. Educ. Behav. Statist., 19, 337-350.
77. Rasbash, J. and Woodhouse, G. (1995) MLn Command Reference. London: Institute of Education.
78. Raudenbush, S. W. (1993) A crossed random effects model for unbalanced data with applications in cross-sectional and longitudinal research. J. Educ. Statist., 18, 321-349.
79. Raudenbush, S. W. and Bryk, A. S. (2002) Hierarchical Linear Models: Applications and Data Analysis Methods, 2nd edn. Newbury Park: Sage.
80. Raudenbush, S. W., Bryk, A. S., Cheong, Y. F. and Congdon, R. T. (2001) HLM5: Hierarchical Linear and Non Linear Modelling. Chicago: Scientific Software International.
81. Rodríguez, G. and Goldman, N. (2001) Improved estimation procedures for multilevel models with binary response: a case-study. J. R. Statist. Soc. A, 164, 339-355.
82. Schools Curriculum and Assessment Authority (1993) Value-added Performance Indicators for Schools. London: Her Majesty's Stationery Office.
83. Snijders, T. A. B. and Bosker, R. J. (1999) Multilevel Analysis: an Introduction to Basic and Advanced Multilevel Modelling. Thousand Oaks: Sage.
84. Steele, F. (1999) Comments on the papers by Diamond et al., Longford, and Fielding. J. R. Statist. Soc. A, 162, 329-330.
85. Stewart, M. B. (1983) On least squares estimation when the dependent variable is grouped. Rev. Econ. Stud., 50, 737-753.
86. Wenglinsky, H. (1997) How money matters: the effect of school district spending on academic achievement. Sociol. Educ., 70, 241-256.
87. Wenglinsky, H. (2002) How schools matter: the link between classroom practices and student academic performance. Educ. Poly Analy. Arch., 10, no. 12.
88. Williams, D. A. (1982) Extra-binomial variation in logistic linear models. Appl. Statist., 31, 144-148.
89. Willms, J. D. (1992) Monitoring School Performance: a Guide for Educators. London: Falmer.
90. Wright, D. (1997) Extra-binomial variation in multilevel logistic models with sparse structures. Br. J. Math. Statist. Psychol., 50, 21-29.
91. Yang, M. (1997) Multilevel models for multiple category responses by MLN simulation. Multilev. Mod. Newslett., 3.
92. Yang, M., Goldstein, H., Browne, W. and Woodhouse, G. (2002) Multivariate multilevel analyses of examination results. J. R. Statist. Soc. A, 165, 137-153.
93. Yang, M., Goldstein, H. and Heath, A. (2000) Multilevel models for repeated binary outcomes: attitudes and voting over the electoral cycle. J. R. Statist. Soc. A, 163, 49-62.
94. Yang, M., Rasbash, J., Goldstein, H. and Barbosa, M. (1999) MLwiN Macros for Advanced Multilevel Modelling, V2.0. London: Institute of Education.
95. Yang, M. and Woodhouse, G. (2001) Progress from GCSE to A and AS level: institutional and gender differences, and trends over time. Br. Educ. Res. J., 27, 245-267.
96. Young, D. Y. (1998) Rural and urban differences in student achievement in science and mathematics: a multilevel analysis. School Effectiv. School Improvmnt, 9, 386-418.