Maximum likelihood approaches to variance component estimation and to related problems

Journal of the American Statistical Association

Volumn 72, Issue 358, 1977, Pages 320-338

  Harville, David A ^a  

^a IOWA STATE UNIVERSITY   (United States)

Author keywords

Maximum likelihood; Maximum likelihood computations; Mixed linear models; Restricted maximum likelihood; Variance component estimation

Indexed keywords

EID: 84890913931     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.1977.10480998     Document Type: Article

References (80)

1. Anderson, R.L., and Bancroft, T.A. (1952), Statistical Theory in Research, New York: McGraw-Hill Book Co.
2. Anderson, T.W. (1969), “Statistical Inference for Covariance Matrices with Linear Structure,” in Multivariate Analysis-II, ed. P.R. Krishnaiah, New York: Academic Press, 55–66.
3. —— (1970), “Estimation of Covariance Matrices Which Are Linear Combinations or Whose Inverses Are Linear Combinations of Given Matrices,” in Essays in Probability and Statistics, eds. R.C. Bose, I.M. Chakravarti, ‘P.C. Mahalanobis, C.R. Rao, and K.J.C. Smith, Chapel Hill, North Carolina: University of North Carolina Press, 1–24.
4. —— (1971), “Estimation of Covariance Matrices with Linear Structure and Moving Average Processes of Finite Order,” Technical Report No. 6, Department of Statistics, Stanford University, Stanford, California.
5. —— (1973), “Asymptotically Efficient Estimation of Covariance Matrices with Linear Structure,” Annals of Statistics, 1, 135–41.
6. Bard, Yonathan (1970), “Comparison of Gradient Methods for the Solution of Nonlinear Parameter Estimation Problems,” SIAM Journal on Numerical Analysis, 7, 157–86.
7. —— (1974), Nonlinear Parameter Estimation, New York: Academic Press.
8. Beltrami, Edward J. (1970), An Algorithmic Approach to Nonlinear Analysis and Optimization, New York: Academic Press.
9. Box, George E.P., and Jenkins, Gwilym M. (1970), Time Series Analysis, San Francisco: Holden-Day.
10. Carroll, C.W. (1961), “The Created Response Surface Technique for Optimizing Nonlinear, Restrained Systems,” Operations Research, 9, 169–84.
11. Corbeil, Robert R., and Searle, Shayle R. (1976a), “Restricted Maximum Likelihood (REML) Estimation of Variance Components in the Mixed Model,” Technometrics, 18, 31–38.
12. ——, and Searle, Shayle R. (1976b), “A Comparison of Variance Component Estimators,” Biometrics, 32, 779–91.
13. Cunningham, E.P., and Henderson, Charles R. (1968), “An Iterative Procedure for Estimating Fixed Effects and Variance Components in Mixed Model Situations,” Biometrics, 24, 13–25.
14. Duncan, David B., and Horn, Susan D. (1972), “Linear Dynamic Recursive Estimation from the Viewpoint of Regression Analysis,” Journal of the American Statistical Association, 67, 815–21.
15. Efron, Bradley, and Morris, Carl (1973), “Stein’s Estimation Rule and Its Competitors—An Empirical Bayes Approach,” Journal of the American Statistical Association, 68, 117–30.
16. ——, and Morris, Carl (1976), “Multivariate Empirical Bayes and Estimation of Covariance Matrices,” Annals of Statistics, 4, 22–32.
17. Gautschi, Werner (1959), “Some Remarks on Herbach’s Paper, ‘Optimum Nature of the F-Test for Model II in the Balanced Case,”’ Annals of Mathematical Statistics, 30, 960–3.
18. Gill, P.E., and Murray, William A., eds. (1974), Numerical Methods for Constrained Optimization, New York: Academic Press.
19. Goldfeld, S.M., Quandt, R.E., and Trotter, H.F. (1966), “Maximization by Quadratic Hill Climbing,” Econometrica, 34, 541–51.
20. Graybill, Franklin A. (1969), Introduction to Matrices with Applications in Statistics, Belmont, California: Wadsworth Publishing Company, Inc.
21. ——, and Hultquist, Robert A. (1961), “Theorems Concerning Eisenhart’s Model II,” Annals of Mathematical Statistics, 32, 261–9.
22. Hartigan, J.A. (1969), “Linear Bayesian Methods,” Journal of the Royal Statistical Society, Series B, 31, 446–54.
23. Hartley, H.O., and Rao, J.N.K. (1967), “Maximum-Likelihood Estimation for the Mixed Analysis of Variance Model,” Biometrika, 54, 93–108.
24. ——, and Vaughn, William K. (1972), “A Computer Program for the Mixed Analysis of Variance Model Based on Maximum Likelihood,” in Statistical Papers in Honor of George W. Snedecor, ed. T.A. Bancroft, Ames, Iowa: Iowa State University Press.
25. Harville, David A. (1969a), “Quadratic Unbiased Estimation of Variance Components for the One-Way Classification,” Biometrika, 56, 313–26. (Correction, (1970), Biometrika, 57, 226.)
26. —— (1969b), “Variance-Component Estimation for the Unbalanced One-Way Random Classification-A Critique,” Technical Report No. 69-0180, Aerospace Research Laboratories, Wright-Patterson AFB, Ohio.
27. —— (1974), “Bayesian Inference for Variance Components Using Only Error Contrasts,” Biometrika, 61, 383–5.
28. —— (1975), “Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems,” Technical Report No. 75-0175, Aerospace Research Laboratories, Wright-Patterson AFB, Ohio.
29. —— (1976), “Extension of the Gauss-Markov Theorem to Include the Estimation of Random Effects,” Annals of Statistics, 4, 384–95.
30. Hemmerle, William J., and Hartley, H.O. (1973), “Computing Maximum Likelihood Estimates for the Mixed A.O.V. Model Using the W Transformation,” Technometrics, 15, 819–31.
31. Henderson, Charles R. (1953), “Estimation of Variance and Covariance Components,” Biometrics, 9, 226–52.
32. —— (1963), “Selection Index and Expected Genetic Advance,” in Statistical Genetics and Plant Breeding, National Academy of Sciences–National Research Council Publication No. 982, 141–63.
33. —— (1973a), “Maximum Likelihood Estimation of Variance Components,” unpublished manuscript.
34. —— (1973b), “MINQUE of Variance Components,” unpublished manuscript.
35. —— (1973c), “Sire Evaluation and Genetic Trends,” in Proceedings of the Animal Breeding and Genetics Symposium in Honor of Dr. Jay L. Lush, Champaign, Illinois: American Society of Animal Science, 10–41.
36. —— (1975), “Best Linear Unbiased Estimation and Prediction Under a Selection Model,” Biometrics, 31, 423–47.
37. Herbach, Leon H. (1959), “Properties of Model II-Type Analysis of Variance Tests, A: Optimum Nature of the F-Test for Model II in the Balanced Case,” Annals of Mathematical Statistics, 30, 939–59.
38. Hocking, Ronald R., and Kutner, Michael H. (1975), “Some Analytical and Numerical Comparisons of Estimators for the Mixed A.O.V. Model,” Biometrics, 31, 19–28.
39. Jennrich, R.I., and Sampson, P.F. (1976), “Newton-Raphson and Related Algorithms for Maximum Likelihood Variance Component Estimation,” Technometrics, 18, 11–17.
40. Klotz, Jerome H., Milton, Roy C., and Zacks, S. (1969), “Mean Square Efficiency of Estimators of Variance Components,” Journal of the American Statistical Association, 64, 1383–402.
41. LaMotte, Lynn R. (1970), “A Class of Estimators of Variance Components,” Technical Report No. 10, Department of Statistics, University of Kentucky, Lexington, Kentucky.
42. —— (1971), “Locally Best Quadratic Estimators of Variance Components,” Technical Report No. 22, Department of Statistics, University of Kentucky, Lexington, Kentucky.
43. —— (1973), “Quadratic Estimation of Variance Components,” Biometrics, 29, 311–30.
44. Lawton, William H., and Sylvestre, Edward A. (1971), “Elimination of Linear Parameters in Nonlinear Regression,” Technometrics, 13, 461–7.
45. Levenberg, K. (1944), “A Method for the Solution of Certain NonLinear Problems in Least Squares,” Quarterly of Applied Mathematics, 2, 164–8.
46. Lindley, Dennis V., and Smith, A.F.M. (1972), “Bayes Estimates for the Linear Model,” Journal of the Royal Statistical Society, Series B, 1–18.
47. Marquardt, Donald W. (1963), “An Algorithm for Least Squares Estimation of Nonlinear Parameters,” SIAM Journal, 11, 431–41.
48. Miller, John J. (1973), “Asymptotic Properties and Computation of Maximum Likelihood Estimates in the Mixed Model of the Analysis of Variance,” Technical Report No. 12, Department of Statistics, Stanford University, Stanford, California.
49. Murray, William A., ed. (1972), Numerical Methods for Unconstrained Optimization, New York: Academic Press.
50. Nelder, J.A. (1968), “The Combination of Information in Generally Balanced Designs,” Journal of the Royal Statistical Society, Ser. B, 30, 303–11.
51. Nering, Evar D. (1970), Linear Algebra and Matrix Theory, 2nd ed., New York: John Wiley & Sons.
52. Olsen, Anthony, Seely, Justus, and Birkes, David (1976), “Invariant Quadratic Unbiased Estimation for Two Variance Components,” Annals of Statistics, 4, 878–90.
53. Patterson, H.D., and Thompson, Robin (1971), “Recovery of InterBlock Information when Block Sizes Are Unequal,” Biometrika, 58, 545–54.
54. ——, and Thompson, Robin (1974), “Maximum Likelihood Estimation of Components of Variance,” Proceedings of the 8th International Biometric Conference, 197–207.
55. Powell, M.J.D. (1970), “A Survey of Numerical Methods for Unconstrained Optimization,” SIAM Review, 12, 79–97.
56. Rao, C.R. (1965), Linear Statistical Inference and Its Applications, New York: John Wiley & Sons.
57. —— (1970), “Estimation of Heteroscedastic Variances in Linear Models,” Journal of the American Statistical Association, 65, 161–72.
58. —— (1971a), “Estimation of Variance and Covariance Components—MINQUE Theory,” Journal of Multivariate Analysis, 1, 257–75.
59. —— (1971b), “Minimum Variance Quadratic Unbiased Estimation of Variance Components,” Journal of Multivariate Analysis, 1, 445–56.
60. —— (1972), “Estimation of Variance and Covariance Components in Linear Models,” Journal of the American Statistical Association, 67, 112–15.
61. Rao, J.N.K. (1968), “On Expectations, Variances, and Covariances of ANOVA Mean Squares by ‘Synthesis’,” Biometrics, 24, 963–78.
62. Russell, Thomas S., and Bradley, Ralph A. (1958), “One-Way Variances in a Two-Way Classification,” Biometrika, 45, 111–29.
63. Searle, Shayle R., (1968), “Another Look at Henderson’s Methods of Estimating Variance Components” (with discussion), Biometrics, 24, 749–87.
64. —— (1970), “Large Sample Variances of Maximum Likelihood Estimators of Variance Components Using Unbalanced Data,” Biometrics, 26, 505–24.
65. —— (1971a), Linear Models, New York: John Wiley & Sons.
66. —— (1971b), “Topics in Variance Component Estimation,” Biometrics, 27, 1–76.
67. —— (1974), “Prediction, Mixed Models, and Variance Components,” in Reliability and Biometry, eds. F. Proschan and R.J. Serfling, Philadelphia, Pennsylvania: Society of Industrial and Applied Mathematics, 229–66.
68. —— (1976), “Detailed Derivation of Results and Relationships in the ML, REML and MINQUE Methods of Estimating Variance Components,” Paper No. BU-586-M, Biometrics Unit, Cornell University, Ithaca, New York.
69. Seely, Justus, (1975), “An Example of an Inquadmissible Analysis of Variance Estimator for a Variance Component, Biometrika, 62, 689–90.
70. Sprott, D.A. (1975), “Marginal and Conditional Sufficiency,” Biometrika, 62, 599–605.
71. Thompson, Robin (1969), “Iterative Estimation of Variance Components for Nonorthogonal Data,” Biometrics, 25, 767–73.
72. —— (1973), “The Estimation of Variance and Covariance Components with an Application when Records Are Subject to Culling,” Biometrics, 29, 527–50.
73. —— (1975), “A Note on the W Transformation,” Technometrics, 17, 511–2.
74. Thompson, W.A., Jr. (1962), “The Problem of Negative Estimates of Variance Components,” Annals of Mathematical Statistics, 33, 273–89.
75. Townsend, Edwin C. (1968), “Unbiased Estimators of Variance Components in Simple Unbalanced Designs,” Ph.D. dissertation, Cornell University, Ithaca, New York.
76. ——, and Searle, Shayle, R. (1971), “Best Quadratic Unbiased Estimation of Variance Components from Unbalanced Data in the 1-Way Classification,” Biometrics, 27, 643–57.
77. Weiss, Lionel (1971), “Asymptotic Properties of Maximum Likelihood Estimators in Some Nonstandard Cases,” Journal of the American Statistical Association, 66, 345–50.
78. —— (1973), “Asymptotic Properties of Maximum Likelihood Estimators in Some Nonstandard Cases, II,” Journal of the American Statistical Association, 68, 428–30.
79. Westlake, Joan R. (1968), A Handbook of Numerical Matrix Inversion and Solution of Linear Equations, New York: John Wiley & Sons.
80. Zacks, S. (1971), The Theory of Statistical Inference, New York: John Wiley & Sons.