MM algorithms for some discrete multivariate distributions

Journal of Computational and Graphical Statistics

Volumn 19, Issue 3, 2010, Pages 645-665

  Zhou, Hua ^a   Lange, Kenneth ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Dirichlet and multinomial distributions; Inequalities; Maximum likelihood; Minorization

Indexed keywords

EID: 77956707384     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2010.09014     Document Type: Article

References (39)

1. 645-665 Asuncion, A., and Newman, D. J. (2007), "(UCI) Machine Learning Repository," available at http://www.ics.uci. edu/~mlearn/ Repository.html. [660]
2. Ayers, K. L., and Lange, K. (2008), "Penalized Estimation of Haplotype Frequencies," Bioinformatics, 24, 1596-1602. [663]
3. Bailey, N. T. J. (1957), The Mathematical Theory of Epidemics, London: Charles Griffin & Company. [649]
4. Blake, A., and Zisserman, A. (1987), Visual Reconstruction, Cambridge, MA: MIT Press. [663]
5. Bouguila, N. (2008), "Clustering of Count Data Using Generalized Dirichlet Multinomial Distributions," IEEE Transactions on Knowledge and Data Engineering, 20 (4), 462-474. [652,660]
6. Charalambides, C. A., (2007), "Distributions of Random Partitions and Their Applications," Methodology and Computing in Applied Probability, 9, 163-193. [658]
7. Connor, R. J., and Mosimann, J. E. (1969), "Concepts of Independence for Proportions With a Generalization of the Dirichlet Distribution," Journal of the American Statistical Association, 64, 194-206. [651]
8. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), "Maximum Likelihood From Incomplete Data via the EM Algorithm" (with discussion), Journal of the Royal Statistical Society, Ser. B, 39 (1), 1-38. [645]
9. de Leeuw, J. (1994), "Block Relaxation Algorithms in Statistics," in Information Systems and Data Analysis, eds. H. H. Bock, W. Lenski, and M. M. Richter, Berlin: Springer-Verlag. [645,656,662]
10. Ewens, W. J. (2004), Mathematical Population Genetics (2nd ed.), New York: Springer-Verlag. [657]
11. Griffiths, D. A. (1973), "Maximum Likelihood Estimation for the Beta-Binomial Distribution and an Application to the Household Distribution of the Total Number of Cases of a Disease," Biometrics, 29, 637-648. [649]
12. Groenen, P. J. F. (1993), The Majorization Approach to Multidimensional Scaling: Some Problems and Extensions, Leiden, The Netherlands: DSWO Press. [645]
13. Haldane, J. B. S. (1941), "The Fitting of Binomial Distributions," Annals of Eugenics, 11, 179-181. [646,649]
14. Haseman, J. K., and Soares, E. R. (1976), "The Distribution of Fetal Death in Control Mice and Its Implications on Statistical Tests for Dominant Lethal Effects," Mutation Research/Fundamental and Molecular Mechanisms of Mutagenesis, 41, 277-288. [651]
15. Heiser, W. J. (1995), "Convergent Computing by Iterative Majorization: Theory and Applications in Multidimensional Data Analysis," in Recent Advances in Descriptive Multivariate Analysis, ed. W. J. Krzanowski, Oxford: Clarendon Press, pp. 157-189. [645]
16. Hunter, D. R., and Lange, K. (2004), "A Tutorial on MM Algorithms," The American Statistician, 58, 30-37. [645,662]
17. Jamshidian, M., and Jennrich, R. I. (1995), "Acceleration of the EM Algorithm by Using Quasi-Newton Methods," Journal of the Royal Statistical Society, Ser. B, 59, 569-587. [648,662]
18. -(1997), "Quasi-Newton Acceleration of the EM Algorithm," Journal of the Royal Statistical Society, Ser. B, 59, 569-587. [648,662]
19. Johnson, N. L., Kotz, S., and Balakrishnan, N. (1997), Discrete Multivariate Distributions, New York: Wiley. [657,663]
20. Lange, K. (1995a), "A Quasi-Newton Acceleration of the EM Algorithm," Statistica Sinica, 5, 1-18. [648,662]
21. - (1995b), "A Gradient Algorithm Locally Equivalent to the EM Algorithm," Journal of the Royal Statis tical Society, Ser. B, 57 (2), 425-437. [662]
22. -(2002), Mathematical and Statistical Methods for Genetic Analysis (2nd ed.), New York: Springer-Verlag. [662]
23. -(2004), Optimization, New York: Springer-Verlag. [645,647,662]
24. Lange, K., and Wu, T. T. (2008), "An MM Algorithm for Multicategory Vertex Discriminant Analysis," Journal of Computational and Graphical Statistics, 17, 527-544. [663]
25. Meng, X. L., and Rubin, D. B. (1991), "Using EM to Obtain Asymptotic Variance-Covariance Matrices: The SEM Algorithm," Journal of the American Statistical Association, 86, 899-909. [662]
26. Minka, T. P. (2003), "Estimating a Dirichlet Distribution," Technical report, Microsoft. [650]
27. Neerchal, N. K., and Morel, J. G. (1998), "Large Cluster Results for Two Parametric Multinomial Extra Variation Models," Journal ofthe American Statistical Association, 93 (443), 1078-1087. [653]
28. -(2005), "An Improved Method for the Computation of Maximum Likelihood Estimates for Multinomial Overdispersion Models," Computational Statistics & Data Analysis, 49 (1), 33-43. [653,660]
29. Nobuaki, H. (2001), "Applying Pitman's Sampling Formula to Microdata Disclosure Risk Assessment," Journal of Official Statistics, 17, 499-520. [658]
30. Nocedal, J., and Wright, S. (2006), Numerical Optimization, New York: Springer. [660]
31. Patil, M. K., and Shirke, D. T. (2007), "Testing Parameter of the Power Series Distribution of a Zero Inflated Power Series Model," Statistical Methodology, 4, 393-406. [660]
32. Paul, S. R., Balasooriya, U., and Banerjee, T. (2005), "Fisher Information Matrix of the Dirichlet-Multinomial Distribution," Biometrical Journal, 47 (2), 230-236. [651]
33. Pitman, J. (1995), "Exchangeable and Partially Exchangeable Random Partitions," Probability Theory and Related Fields, 102 (2), 145-158. [657]
34. Sabatti, C, and Lange, K. (2002), "Genomewide Motif Identification Using a Dictionary Model," Proceedings of the IEEE, 90, 1803-1810. [663]
35. Steele, J. M. (2004), The Cauchy-Schwarz Master Class. MAA Problem Books Series, Washington, DC: Mathematical Association of America. [647]
36. Ueda, N., and Nakano, R. (1998), "Deterministic Annealing EM Algorithm," Neural Networks, 11, 271-282. [662]
37. Varadhan, R., and Roland, C. (2008), "Simple and Globally Convergent Methods for Accelerating the Convergence of Any EM Algorithm," Scandinavian Journal of Statistics, 35, 335-353. [648,662]
38. Wu, T. T., and Lange K. (2010), "The MM Alternative to EM," Statistical Science, to appear. [645]
39. Zhou, H., and Lange, K. (2010), "On the Bumpy Road to the Dominant Mode," Scandinavian Journal of Statistics, to appear. [663]