The three basic types of residuals for a linear model

International Statistical Review

Volumn 75, Issue 1, 2007, Pages 1-24

  Haslett, John ^a   Haslett, Stephen J ^b  

^a TRINITY COLLEGE DUBLIN   (Ireland)

^b MASSEY UNIVERSITY   (New Zealand)

Author keywords

Linear mixed model; Longitudinal data; Multi level model; Random coefficients; Spatial data; Time series

Indexed keywords

EID: 34247253374     PISSN: 03067734     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2006.00001.x     Document Type: Article

References (61)

1. Afifi, A., Clark, V.A. & May, S. (2004). Computer-Aided Multivariate Analysis, 4th ed. Boea Raton, FL: Chapman and Hall
2. Atkinson, A.C., Riani, M. & Cerioli, A. (2004). Exploring Multivariate Data with the Forward Search. New York; London: Springer-Verlag.
3. Banerjee, S., Carlin, B.P. & Gelfand, A. (2003). Hierarchical Modeling and Analysis for Spatial Data. London: CRC Press.
4. Brillinger, D.R. (1987). Comments on "What Is an Analysis of Variance?" Ann. Stat., 15, 916-917.
5. Brown, R.L., Durbin, J. & Evans, J.M. (1975). Techniques for testing the constancy of regression relationships over time. J. R. Stat. Soc., Ser. B, Methodol., 37, 149-192.
6. Chiles, J.-P. & Delfiner, P. (1999). Geostatistics: Modeling Spatial Uncertainty. New York; Chichester: Wiley.
7. Christensen, R. (1991). Linear Models for Multivariate, Time Series, and Spatial Data. New York: Springer-Verlag.
8. Christensen, R. (2001). Advanced Linear Modeling: Multivariate, Time Series, and Spatial Data; Nonparametric Regression and Response Surface Maximization. New York: Springer-Verlag.
9. Christensen, R., Johnson, W. & Pearson, L.M. (1992). Prediction Diagnostics for Spatial Linear Models. Biometrika, 79, 583-591.
10. Cook, R.D. (1982). Residuals. In Encyclopedia Stat. Sci., 8 (9 vols. plus supplement), Eds. S. Kotz and L. Johnson. New York: Wiley.
11. Cox, D.R. & Snell, E.J. (1968). A general definition of residuals (with discussion). J. R. Stat. Soc., Ser. B, Methodol., 30, 248-275.
12. Cox, D.R. & Solomon, P.J. (2003). Components of Variance. Boca Raton, FL: Chapman and Hall.
13. Davison, A.C. & Snell, E.J. (1991). Residuals and diagnostics. In Statistical Theory and Modelling. In Honour of Sir David Cox, FRS, Eds. D. Hinkley, N. Reid and E. Snell. Boca Raton, FL: Chapman and Hall.
14. del Pino, G. (1989). The unifying role of iterative generalized least squares in statistical algorithms (C/R: p403-408). Stat. Sci., 4, 394-403.
15. Demidenko, E. (2004). Mixed Models Theory and Applications. Hoboken, NJ: Wiley.
16. Diggle, P., Liang, K.-Y. & Zeger, S.L. (1994). Analysis of Longitudinal Data. Oxford: Clarendon Press.
17. Dillane, D. (2006). Deletion diagnostics for the linear mixed model. Ph.D. thesis, Trinity College, Dublin, Dept of Statistics, TCD, Dublin 2, Ireland.
18. Fitzmaurice, G., Laird, N. & Ware, J. (2004). Applied Longitudinal Analysis. Hoboken, NJ: Wiley.
19. Fox, A.J. (1972). Outliers in time series. J. R. Stat. Soc., Ser. B, Methodol., 34, 350-363.
20. Fraccaro, R., Hyndman, R.J. & Veevers, A. (2000). Residual diagnostic plots for checking for model mis-specification in time series regression. Aust. N. Z. J. Stat. [Formerly: @J(AstrlJSt) and @J(NZndSt)], 42(4), 463-477.
21. Harville, D.A. (1997). Matrix Algebra from a Statistician 's Perspective. New York: Springer-Verlag.
22. Haslett, J. (1999). A simple derivation of deletion diagnostic results for the general linear model with correlated errors. J. R. Stat. Soc., Ser. B, Methodol., 61, 603-609.
23. Haslett, J. & Dillane, D. (2004). Application of 'delete = replace' to deletion diagnostics for variance component estimation in the linear mixed model. J. R. Stat. Soc., Ser. B, Methodol., 66, 131-144.
24. Haslett, J. & Hayes, K. (1998). Residuals for the linear model with general covariance structure. J. R. Stat. Soc., Ser. B, Methodol, 60, 201-215.
25. Haslett, J., Murphy, B. & Haslett, S. (2006). Delete = Replace; in preparation.
26. Haslett, S. (1985). Recursive Estimation of the General Linear Model with Dependent Errors and Multiple Additional Observations. Aust. J. Stat., 27, 183-188.
27. Haslett, S. (1996). Updating linear models with dependent errors to include additional data and/or parameters. Linear Algeb. Appl., 237, 329-349.
28. Hayes, K. & Haslett, J. (1999). Simplifying general least squares. Am. Stat., 53, 376-381.
29. Houseman, A.E., Ryan, L.M. & Coull, B.A. (2004). Cholesky residuals for assessing normal errors in a linear model with correlated outcomes. J. Am. Stat. Assoc., 99, 383-394.
30. Kempthorne, O. (1989). Comments on the Equality of the Ordinary Least Squares Estimator and the Best Linear Unbiased Estimator. Am. Stat., 43, 161-162.
31. Kianifard, F. & Swallow, W.H. (1996). A review of the development and application of recursive residuals in linear models. J. Am. Stat. Assoc., 91, 391-400.
32. Kitanidis, P.K. (1991). Orthonormal residuals in geostatistics: Model criticism and parameter estimation. Math. Geol., 23, 741-758.
33. Lange, N. & Ryan, L. (1989). Assessing normality in random effects models. Ann. Stat., 17, 624-642.
34. Larsen, W.A. & McCleary, S.J. (1972). The Use of Partial Residual Plots in Regression Analysis. Technometrics, 14, 781-790.
35. Li, W.K. (2004). Diagnostic Checks in Time Series. Boca Raton: Chapman and Hall/CRC.
36. Lipschitz, S. & Lipson, M. (2001). Linear Algebra, 3rd ed. New York: McGraw Hill.
37. Martin, R.J. (1992). Leverage, influence and residuals in regression models when observations are correlated. Commun. Stat., A-Theory Methods, 21, 1183-1212.
38. McGilchrist, C.A. & Sandland, R.L. (1979). Recursive estimation of the general linear model with dependent errors. J. R. Stat. Soc., Ser. B, Methodol., 41, 65-68.
39. Morrison, D.M. (2005). Multivariate Statistical Methods, 4th ed. Australia; United Kingdom: Thomson.
40. Oman, S.D. (1995). Checking the assumptions in mixed-model analysis of variance: A residual analysis approach. Comput. Stat. Data Anal., 20, 309-330.
41. Pan, J.-X. & Fang, K.-T. (2000). Growth curve models and statistical diagnostics. New York: Springer-Verlag.
42. Pawitan, Y. (2001). In all likelihood: statistical modelling and inference using likelihood. Oxford: Oxford University Press.
43. Pena, D. (1986). Comments on 'Assessment of Local Influence'. J. R. Stat. Soc., Ser. B: Methodol., 48, 164-165.
44. Pena, D. (2001). Outliers, influential observations and missing data. In A Course in Time Series Analysis, Eds. D. Pena, G. Tiao and R. Tsay, pp. 86-110.
45. Pickford, M. & Haslett, S. (1999). A statistical test of single firm market power. N. Z. Econo. Pap., 33, 39-58.
46. Rao, C.R. (1973). Linear statistical inference and its applications. New York; Chichester: Wiley.
47. Rao, C.R. (1985). A unified approach to inference from linear models, In Proceedings of the First International Tampere Seminar on Linear Statistical Models and their Applications, pp. 9-36.
48. Rao, C.R. & Mitra, S.K. (1971). Generalized Inverse of Matrices and its Applications. New York; Chichester: Wiley.
49. Robinson, G.K. (1991). That BLUP is a good thing: The estimation of random effects (Disc: p. 32-51). Stat. Sci., 6, 15-32.
50. Rue, H. & Held, L. (2005). Gaussian Markov Random Fields: Theory and Applications. London: Chapman and Hall.
51. Schabenberger, O. (2004). Mixed Model Influence Diagnostics. In Proceedings of the Twenty-Ninth Annual SAS Users Group International Conference, pp. 189-229.
52. Schott, J.R. (1997). Matrix analysis for statistics. New York; Chichester: Wiley.
53. Skrondal, A. & Rabe-Hesketh, S. (2004). Generalized Latent Variable Modeling: Multilevel, Longitudinal and Structural Equation Models. New York: Springer-Verlag.
54. Speed, T. (1991). Comment on 'That BLUP is a good thing: The estimation of random effects'. Stat. Sci., 6, 42-44.
55. Stein, M. (1999). Interpolation of spatial data: some theory for kriging. New York: Springer-Verlag.
56. Sullivan, C. (2001). A diagnostic for the General Linear Model: an Application to Time Series, Ph.D. thesis, Trinity College, Dublin, Dept of Statistics, TCD, Dublin 2, Ireland.
57. Theil, H. (1965). The analysis of disturbances in regression analysis (Ref: V63, pp. 242-251). J. Am. Stat. Assoc., 60, pp. 1067-1079.
58. Tunnicliffe-Wilson, G. (2001). Model Fitting and Checking, and the Kalman Filter. In A Course in Time Series Analysis, Eds. Pena, D., Tiao, G. and Tsay, R., pp. 86-110. New York: Wiley.
59. Wahba, G. (1990). Spline models for observational data. Philadelphia, PA: Society for Industrial and Applied Mathematics.
60. Weiss, R.E. & Lazaro, C.G. (1992). Residual plots for repeated measures. Stat. Med., 11, 115-124.
61. Whittaker, J. (1990). Graphical models in applied multivariate statistics. Chichester: Wiley.