Optimization Transfer Using Surrogate Objective Functions

Journal of Computational and Graphical Statistics

Volumn 9, Issue 1, 2000, Pages 1-20

  Langed, Kenneth ^a   Hunter, Avid R ^b   Yang, Ilsoon ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c MERCK RESEARCH LABORATORIES   (United States)

Author keywords

Convexity; EM algorithm; Majorization; Maximum likelihood; Newton s method

Indexed keywords

EID: 77950023906     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2000.10474858     Document Type: Article

References (42)

1. Becker, M. P., Yang, I., and Lange, K. (1997), “EM Algorithms Without Missing Data,” Statistical Methods in Medical Research, 6, 38-54.
2. Bohning, D. (1992), “Multinomial Logistic Regression Algorithm,” Annals Institute of Statistical Mathematics, 44, 197-200.
3. Bohning, D., and Lindsay, B. G. (1988), “Monotonicity of Quadratic Approximation Algorithms,” Annals Institute of Statistical Mathematics, 40, 641-663.
4. Borg, I., and Groenen, P. (1997), Modem Multidimensional Scaling, New York: Springer-Verlag.
5. Boyer, R., and Savageau, D. (1989), Places Rated Almanac, New York: Prentice Hall.
6. Bradley, R. A., and Terry, M. E. (1952), “Rank Analysis of Incomplete Block Designs,” Biometrika, 39, 324-345.
7. Conn, A. R., Gould, N. I. M., and Toint, P. L. (1991), “Convergence of Quasi-Newton Matrices Generated by the Symmetric Rank One Update,” Mathematical Programming, 50, 177-195.
8. Davidon, W. C. (1959), “Variable Metric Methods for Minimization,” AEC Research and Development Report ANL-5990, Argonne National Laboratory.
9. de Leeuw, J. (1994), “Block Relaxation Algorithms in Statistics,” in Information Systems and Data Analysis, ed. H. H. Bock, W. Lenski, and M. M. Richter, Berlin: Springer-Verlag, pp. 308-325.
10. de Leeuw, J., and Heiser, W. J. (1977), “Convergence of Correction Matrix Algorithms for Multidimensional Scaling,” in Geometric Representations of Relational Data, eds. I. C. Lingoes, E. Roskam, and I. Borg, Ann Arbor: Mathesis Press, pp. 735-752.
11. de Leeuw, J., and Heiser, W. J. (1980), “Multidimensional Scaling With Restrictions on the Configuration,” in Multivariate Analysis, Vol. V, ed. P. R. Krishnaiah, Amsterdam: North-Holland, pp. 501-522.
12. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), “Maximum Likelihood From Incomplete Data via the EM Algorithm," Journal of the Royal Statistical Society, Series B, 39, 1-38.
13. De Pierro, A. R. (1995), “A Modified Expectation Maximization Algorithm for Penalized Likelihood Estimation in Emission Tomography,” IEEE Transactions on Medical Imaging, 14, 132-137.
14. Efron, B. (1991), “Regression Percentiles Using Asymmetric Squared Error Loss,” Statistica Sinica, 1, 93-125.
15. Groenen, P. J. F. (1993), The Majorization Approach to Multidimensional Scaling: Some Problems and Extensions, Leiden, the Netherlands: DSWO Press.
16. Heiser, W. J. (1995), “Convergent Computing by Iterative Majorization: Theory and Applications in Multidimensional Data Analysis,” in Recent Advances in Descriptive Multivariate Analysis, ed. W. J. Krzanowski, Oxford: Clarendon Press, pp. 157-189.
17. Horn, R. A., and Johnson, C. R. (1985), Matrix Analysis, Cambridge: Cambridge University Press.
18. Householder, A. S. (1975), The Theory of Matrices in Numerical Analysis, New York: Dover.
19. Huber, P. J. (1981), Robust Statistics, New York: Wiley.
20. Hunter, D. R., and Lange, K. (1999), “Computing Estimates in the Proportional Odds Model,” unpublished manuscript.
21. Hunter, D. R., and Lange, K. (2000), “Quantile Regression van an MM Algorithm," Journal of Compuational and Graphical Statistics, 9, 60-77.
22. Jamshidian, M., and Jennrich, R. I. (1993), “Conjugate Gradient Acceleration of the EM Algorithm,” Journal of the American Statistical Association, 88, 221-228.
23. Jamshidian, M., and Jennrich, R. I. (1997), “Quasi-Newton Acceleration of the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 59, 569-587.
24. Keener, J. P. (1993), “The Perron-Frobenius Theorem and the Ranking of Football Teams,” SIAM Review, 35, 80-93.
25. Khalfan, H. F., Byrd, R. H., and Schnabel, R. B. (1993), “A Theoretical and Experimental Study of the Symmetric Rank-One Update,” SIAM Journal on Optimization, 3, 1-24.
26. Konno, H., Thach, P. T., and Tuy, H. (1997), Optimization on Low Rank Nonconvex Structures, Dordecht, the Netherlands: Kluwer Academic Publishers.
27. Lange, K. (1994), “An Adaptive Barrier Method for Convex Programming,” Methods Applications Analysis, 1, 392-402.
28. Lange, K. (1995a), “A Quasi-Newton Acceleration of the EM Algorithm,” Statistica Sinica, 5, 1-18.
29. Lange, K. (1995b), “A Gradient Algorithm Locally Equivalent to the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 57, 425-437.
30. Lange, K., and Fessler, J. A. (1995c), “Globally Convergent Algorithms for Maximum A Posteriori Transmission Tomography,” IEEE Transactions on Image Processing, 4, 1430-1438.
31. Lange, K., Little, R. J. A., and Taylor, J. M. G. (1989), “Robust Statistical Modeling Using the t Distribution,” Journal of the American Statistical Association, 84, 881-896.
32. Lange, K., and Sinsheimer, J. (1993), “Normal/Independent Distributions and Their Applications in Robust Regression,” Journal of Computational and Statistical Graphics, 2, 175-198.
33. Little, R. J. A., and Rubin, D. B. (1987), Statistical Analysis with Missing Data, New York: Wiley.
34. Luenberger, D. G. (1984), Linear and Nonlinear Programming (2nd ed.), Reading, MA: Addison-Wesley.
35. Marshall, A. W., and Olkin, I. (1979), Inequalities: Theory of Majorization and its Applications, San Diego: Academic Press.
36. McLachlan, G. J., and Krishnan, T. (1997), The EM Algorithm and Extensions, New York: Wiley.
37. Mosteller, F., and Tukey, J. W. (1977), Data Analysis and Regression: A Second Course in Statistics, Reading, MA: Addison-Wesley.
38. Ortega, J. M., and Rheinboldt, W. C. (1970), Iterative Solutions of Nonlinear Equations in Several Variables, New York: Academic Press.
39. Peressini, A. L., Sullivan, F. E., and Uhl, J. J. Jr. (1988), The Mathematics of Nonlinear Programming, New York: Springer.
40. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. (1992), Numerical Recipes in Fortran: The Art of Scientific Computing (2nd ed.), Cambridge: Cambridge University Press.
41. Rousseeuw, P. J., and Leroy, A. M. (1987), Robust Regression and Outlier Detection, New York: Wiley.
42. Schlossmacher, E. J. (1973), “An Iterative Technique for Absolute Deviations Curve Fitting," Journal of the American Statistical Association, 68, 857-859.