Maximum likelihood estimation in log-linear models

Annals of Statistics

Volumn 40, Issue 2, 2012, Pages 996-1023

  Fienberg, Stephen E ^a   Rinaldo, Alessandro ^b  

^a Carnegie Mellon University   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Extended exponential families; Extended maximum likelihood estimators; Log linear models; Newton Raphson algorithm; Sampling zeros

Indexed keywords

EID: 84867501988     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/12-AOS986     Document Type: Article

References (49)

1. Agresti, A. (2002). Categorical Data Analysis, 2Nd Ed. Wiley, New York. Mr1914507
2. Aickin, M. (1979). Existence of Mles for Discrete Linear Exponential Models. Ann. inst. Statist. Math. 31 103-113. Mr0541956
3. Barndorff-Nielsen, O. (1978). information and Exponential Families in Statistical Theory. Wiley, Chichester. Mr0489333
4. Birch, M. W. (1963). Maximum Likelihood in Three-Way Contingency Tables. J. Roy. Statist. Soc. Ser. B 25 220-233. Mr0168065
5. Bishop, Y. M. M., Fienberg, S. E. and Holland, P. W. (1975). Discrete Multivariate Analysis. Mit Press, Cambridge, Ma. Reprinted By Springer (2007). Mr0381130
6. Brown, L. D. (1986). Fundamentals of Statistical Exponential Families with Applications in Statistical Decision Theory. institute of Mathematical Statistics Lecture Notes - Monograph Series 9. Ims, Hayward, Ca. Mr0882001
7. Cencov, N. N. (1982). Statistical Decision Rules and Optimal inference. Translations of Mathematical Monographs 53. Amer. Math. Soc., Providence, Ri. Mr0645898
8. Christensen, R. (1997). Log-Linear Models and Logistic Regression, 2Nd Ed. Springer, New York. Mr1633357
9. CsiszáR, I. (1975). I -Divergence Geometry of Probability Distributions and Minimization Problems. Ann. Probab. 3 146-158. Mr0365798
10. CsiszáR, I. (1989). A Geometric interpretation of Darroch and Ratcliff's Generalized Iterative Scaling. Ann. Statist. 17 1409-1413. Mr1015161
11. CsiszáR, I. andmatúš, F. (2001). Convex Cores of Measures on Rd . Studia Sci. Math. Hungar. 38 177-190. Mr1877777
12. CsiszáR, I. andmatúš, F. (2003). information Projections Revisited. Ieee Trans. inform. Theory 49 1474-1490. Mr1984936
13. CsiszáR, I. and Matúš, F. (2005). Closures of Exponential Families. Ann. Probab. 33 582-600. Mr2123202
14. CsiszáR, I. and Matúš, F. (2008). Generalized Maximum Likelihood Estimates for Exponential Families. Probab. Theory Related Fields 141 213-246. Mr2372970
15. Darroch, J. N. and Ratcliff, D. (1972). Generalized Iterative Scaling for Log-Linear Models. Ann. Math. Statist. 43 1470-1480. Mr0345337
16. Dobra, A. and Massam, H. (2010). The Mode Oriented Stochastic Search (Moss) Algorithm for Log-Linear Models with Conjugate Priors. Stat. Methodol. 7 240-253. Mr2643600
17. Dobra, A., Fienberg, S. E., Rinaldo, A., Slavkovic, A. and Zhou, Y. (2009). Algebraic Statistics and Contingency Table Problems: Log-Linear Models, Likelihood Estimation, and Disclosure Limitation. in Emerging Applications of Algebraic Geometry (Putinar, M. and Sullivan, S., Eds.). Ima Vol. Math. Appl. 149 63-88. Springer, New York. Mr2500464
18. Drton, M., Sturmfels, B. and Sullivant, S. (2009). Lectures on Algebraic Statistics. Oberwolfach Seminars 39. BirkhäUser, Basel. Mr2723140
19. Eriksson, N., Fienberg, S. E., Rinaldo, A. and Sullivant, S. (2006). Polyhedral Conditions for The Nonexistence of The Mle for Hierarchical Log-Linear Models. J. Symbolic Comput. 41 222- 233. Mr2197157
20. Erosheva, E. A., Fienberg, S. E. and Joutard, C. (2007). Describing Disability Through individual-Level Mixture Models for Multivariate Binary Data. Ann. Appl. Stat. 1 502-537. Mr2415745
21. Ewald, G. (1996). Combinatorial Convexity and Algebraic Geometry. Graduate Texts in Mathematics 168. Springer, New York. Mr1418400
22. Fienberg, S. E. and Rinaldo, A. (2007). Three Centuries of Categorical Data Analysis: Loglinear Models and Maximum Likelihood Estimation. J. Statist. Plann. inference 137 3430-3445. Mr2363267
23. Fienberg, S. E. and Rinaldo, A. (2012). Maximum Likelihood Estimation in Log-Linear Models - Supplementary Material. Technical Report, Carnegie Mellon Univ. Available At http://www.Stat. Cmu.Edu/Arinaldo/Fienberg-Rinaldo- Supplementary-Material.Pdf.
24. forster, J. (2004). Bayesian inference for Poisson and Multinomial Log-Linear Models. Technical Report, School of Mathematics, Univ. Southampton.
25. Fulton, W. (1993). introduction to toric Varieties. Annals of Mathematics Studies 131. Princeton Univ. Press, Princeton, Nj. Mr1234037
26. Gawrilow, E. and Joswig, M. (2000). Polymake: A Framework for Analyzing Convex Polytopes. in Polytopes - Combinatorics and Computation (Oberwolfach, 1997). Dmv Sem. 29 43- 73. BirkhäUser, Basel. Mr1785292
27. Geiger, D.,Meek, C. and Sturmfels, B. (2006). on The toric Algebra of Graphical Models. Ann. Statist. 34 1463-1492. Mr2278364
28. Geyer, C. J. (2009). Likelihood inference in Exponential Families and Directions of Recession. Electron. J. Stat. 3 259-289. Mr2495839
29. Haberman, S. J. (1974). The Analysis of Frequency Data. Univ. Chicago Press, Chicago, Il. Mr0408098
30. Haberman, S. J. (1977). Log-Linear Models and Frequency Tables with Small Expected Cell Counts. Ann. Statist. 5 1148-1169. Mr0448675
31. King, R. and Brooks, S. P. (2001). Prior induction in Log-Linear Models for General Contingency Table Analysis. Ann. Statist. 29 715-747. Mr1865338
32. Koehler, K. J. (1986). Goodness-of-Fit Tests for Log-Linear Models in Sparse Contingency Tables. J. Amer. Statist. Assoc. 81 483-493. Mr0845887
33. Lang, J. B. (2004).Multinomial-Poisson Homogeneous Models for Contingency Tables. Ann. Statist. 32 340-383. Mr2051011
34. Lang, J. B. (2005). Homogeneous Linear Predictor Models for Contingency Tables. J. Amer. Statist. Assoc. 100 121-134. Mr2156823
35. Lauritzen, S. L. (1996). Graphical Models. Oxford Statistical Science Series 17. Oxford Univ. Press, New York. Mr1419991
36. Letac, G. (1992). Lectures on Natural Exponential Families and Their Variance Functions. MonografíAs De MatemáTica [Mathematical Monographs] 50. instituto De MatemáTica Pura E Aplicada (Impa), Rio De Janeiro. Mr1182991
37. Massam, H., Liu, J. and Dobra, A. (2009). A Conjugate Prior for Discrete Hierarchical Log-Linear Models. Ann. Statist. 37 3431-3467. Mr2549565
38. Morris, C. (1975). Central Limit Theorems for Multinomial Sums. Ann. Statist. 3 165-188. Mr0370871
39. Morton, J. (2008). Relations Among Conditional Probabilities. Technical Report. Arxiv:0808.1149V1.
40. Nardi, Y. and Rinaldo, A. (2012). The Log-Linear Group-Lasso Estimator and Its Asymptotic Properties. Bernoulli. to Appear.
41. Pachter, L. and Sturmfels, B. (2005). Algebraic Statistics for Computational Biology. Cambridge Univ. Press, New York. Mr2205865
42. Read, T. R. C. and Cressie, N. A. C. (1988). Goodness-of-Fit Statistics for Discrete Multivariate Data. Springer Series in Statistics. Springer, New York. Mr0955054
43. R Development Core Team (2005). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Isbn 3-900051-07-0, Available At http://www.R-Project.Org.
44. Rinaldo, A., Fienberg, S. E. and Zhou, Y. (2009). on The Geometry of Discrete Exponential Families with Application to Exponential Random Graph Models. Electron. J. Stat. 3 446-484. Mr2507456
45. Rinaldo, A., Petrovi'c, S. and Fienberg, S. (2011).Maximum Likelihood Estimation in Network Models. Technical Report. Available At http://Arxiv.Org/Abs/1105.6145.
46. Rockafellar, R. T. (1970). Convex Analysis. Princeton Mathematical Series 28. Princeton Univ. Press, Princeton, Nj. Mr0274683
47. Schrijver, A. (1998). Theory of Linear and integer Programming. Wiley, New York.
48. Verbeek, A. (1992). The Compactification of Generalized Linear Models. Statist. Neerlandica 46 107-142. Mr1178475
49. Ziegler, M. G. (1995). Lectures on Polytopes. Springer, New York. Mr1311028