On the Bumpy Road to the Dominant Mode

Scandinavian Journal of Statistics

Volumn 37, Issue 4, 2010, Pages 612-631

  Zhou, Hua ^a   Lange, Kenneth L ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Deterministic annealing; Factor analysis; Global optimization; Maximum likelihood; Mixture model; Multidimensional scaling; Multivariate t distribution; Random effects model

Indexed keywords

EID: 77956676222     PISSN: 03036898     EISSN: 14679469     Source Type: Journal    
DOI: 10.1111/j.1467-9469.2009.00681.x     Document Type: Article

References (29)

1. Agresti, A. (2002). Categorical data analysis, 2nd edn. Wiley-Interscience, New York.
2. Arslan, O., Constable, P. & Kent, J. (1993). Domains of convergence for the EM algorithm: a cautionary tale in a location estimation problem. Statist. Comput. 3, 103-108.
3. Becker, M. P., Yang, I. & Lange, K. L. (1997). EM algorithms without missing data. Stat. Methods Med. Res. 6, 37-53.
4. Bouguila, N. (2008). Clustering of count data using generalized Dirichlet multinomial distributions. IEEE Trans. Knowl. Data Eng. 20, 462-474.
5. Dempster, A. P., Laird, N. M. & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39, 1-38.
6. Duan, J. C. & Simonato, J. G. (1993). Multiplicity of solutions in maximum likelihood factor analysis. J. Statist. Comput. Simulation 47, 37-47.
7. Goodman, L. A. (1974). Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 61, 215-231.
8. Groenen, P. J. F. & Heiser, W. J. (1996). The tunneling method for global optimization in multidimensional scaling. Psychometrika 61, 529-550.
9. Heiser, W. J. (1995). Convergent computing by iterative majorization: theory and applications in multidimensional data analysis. In Recent advances in descriptive multivariate analysis (eds W. J. Krzanowski), 157-189. Clarendon Press, Oxford.
10. Hunter, D. R. & Lange, K. L. (2004). A tutorial on MM algorithms. Amer. Statist. 58, 30-37.
11. Kent, J. T., Tyler, D. E. & Vardi, Y. (1994). A curious likelihood identity for the multivariate t-distribution. Comput. Stat. Data Anal. 41, 157-170.
12. Kirkpatrick, S., Gelatt, C. D. & Vecchi, M. P. (1983). Optimization by simulated annealing. Science 220, 671-680.
13. Lange, K. L. (2004). Optimization. Springer-Verlag, New York.
14. Lange, K. L. & Sinsheimer, J. S. (1993). Normal/independent distributions and their applications in robust regression. J. Comput. Graph. Statist. 2, 175-198.
15. Lange, K. L., Little, R. J. A. & Taylor, J. M. G. (1989). Robust statistical modeling using the t distribution. J. Amer. Statist. Assoc. 84, 881-896.
16. Lange, K. L., Hunter, D. R. & Yang, I. (2000). Optimization transfer using surrogate objective functions (with discussion). J. Comput. Graph. Statist. 9, 1-59.
17. De Leeuw, J. (1993). Fitting distances by least squares. Unpublished manuscript. Available on
18. De Leeuw, J. (1994). Block relaxation algorithms in statistics. In Information systems and data analysis (eds H. H. Bock, W. Lenski & M. M. Richter), 308-325. Springer-Verlag, New York.
19. Liu, J. & Hodges, J. S. (2003). Posterior bimodality in the balanced one-way random effects model. J. Roy. Statist. Soc. Ser. B 65, 247-255.
20. Maxwell, A. E. (1961). Recent trends in factor analysis. J. Roy. Statist. Soc. Ser. A 124, 49-59.
21. McLachlan, G. J. & Krishnan, T. (2008). The EM algorithm and extensions, 2nd edn. Wiley-Interscience, Hoboken, NJ.
22. Meng, X. L. & Van Dyk, D. (1997). The EM algorithm - an old folk-song sung to a fast new tune. J. Roy. Statist. Soc. Ser. B 59, 511-567.
23. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A. & Teller, E. (1953). Equations of state calculations by fast computing machines. J. Chem. Phys. 21, 1087-1092.
24. Pachter, L. & Sturmfels, B. (2005). Algebraic statistics and computational biology. Cambridge University Press, Cambridge.
25. Press, W. H., Teukolsky, S. A., Vetterling, W. T. & Flannery, B. P. (1992). Numerical recipes in Fortran: the art of scientific computing, 2nd edn. Cambridge University Press, Cambridge.
26. Robert, C. P. & Casella, G. (2004). Monte Carlo statistical methods, 2nd edn. Springer-Verlag, New York.
27. Rue, H., Martino, S. & Chopin, N. (2009). Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations (with discussion). J. Roy. Statist. Soc. Ser. B 71, 319-392.
28. Ueda, N. & Nakano, R. (1998). Deterministic annealing EM algorithm. Neural Netw. 11, 271-282.
29. Wu, T. T. & Lange, K. L. (2009). The MM alternative to EM. Statist. Sci. (in press).