Three centuries of categorical data analysis: Log-linear models and maximum likelihood estimation

Journal of Statistical Planning and Inference

Volumn 137, Issue 11, 2007, Pages 3430-3445

  Fienberg, Stephen E ^a,b   Rinaldo, Alessandro ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

Algebraic statistics; Chi square tests; Contingency tables; Log linear models; Maximum likelihood; Multinomial sampling schemes; Sampling zeros

Indexed keywords

EID: 34447516910     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2007.03.022     Document Type: Article

References (79)

1. Agresti A. A survey of exact inference for contegency tables. Statist. Sci. 7 (1992) 131-153
2. Agresti A. Categorical Data Analysis. second ed (2002), Wiley, New York
3. Asmussen S., and Edwards D. Collapsibility and response variables in contingency tables. Biometrika 70 (1983) 567-578
4. Bartlett M.S. Contingency table interactions. J. Roy. Statist. Soc. (Suppl.) 2 2 (1935) 248-252
5. Bhapkar V.P. Some tests for categorical data. Ann. Math. Statist. 29 (1961) 302-306
6. Bhapkar V.P. A note on the equivalence of two test criteria for hypotheses in categorical data. J. Amer. Statist. Assoc. 61 (1966) 228-235
7. Bhapkar V.P., and Koch G.G. On the hypotheses of "no interaction" in contingency tables. Biometrics 24 (1968) 567-594
8. Birch M.W. Maximum likelihood in three-way contingency tables. J. Roy. Statist. Soc. 25 (1963) 220-233
9. Bishop, Y.M.M., 1967. Multi-dimensional contingency tables: cell estimates. Ph.D. Thesis, Department of Statistics, Harvard University.
10. Bishop Y.M.M. Full contingency tables, logits, and split contingency tables. Biometrics 25 2 (1969) 119-128
11. Bishop Y.M.M., Fienberg S.E., and Holland P.W. Discrete Multivariate Analysis (1975), MIT Press, Cambridge, MA. Reprinted 2007, Springer-Verlag, New York
12. Brown, L.D., 1986. Fundamental of Statistical Exponential Families. IMS Lecture Notes-Monograph Series, vol. 9, Institute of Mathematical Statistics, Hayward, CA.
13. Charnes A., Frome E.L., and Yu P.L. The equivalence of generalized least squares and maximum likelihood estimates in the exponential family. J. Amer. Statist. Assoc. 71 353 (1976) 169-171
14. 2 test of goodness of fit. Ann. Math. Statist. 23 (1952) 315-345
15. 2 tests. Biometrics 10 (1954) 417-451
16. Cressie N.A.C., and Read T.R.C. Goodness-of-Fit Statistics for Discrete Multivariate Data (1988), Springer, New York
17. Darroch J.N. Interaction in multi-factor contingency tables. J. Roy. Statist. Soc. 24 (1962) 251-263
18. Darroch J.N., Lauritzen S.L., and Speed T.P. Markov fields and log-linear interaction models for contingency tables. Ann. Statist. 8 3 (1980) 522-539
19. De Loera J., and Onn S. Markov bases of three-way tables are arbitrarily complicated. J. Symbolic Comput. 41 (2006) 173-181
20. Deming W.E., and Stephan F.F. On a least square adjustment of a sampled frequency table when the expected marginal totals are known. Ann. Math. Statist. 11 (1940) 427-444
21. Diaconis P., and Sturmfels B. Algebraic algorithms for sampling from conditional distributions. Ann. Statist. 26 1 (1998) 363-397
22. Edwards D. Introduction to Graphical Modelling (1995), Springer, New York
23. Eriksson N., Fienberg S.E., Rinaldo A., and Sullivant S. Polyhedral conditions for the nonexistence of the MLE for hierarchical log-linear models. J. Symbolic Comput. 41 (2006) 222-233
24. Erosheva E.A., Fienberg S.E., and Junker B.W. Alternative statistical models and representations for large sparse multi-dimensional contingency tables. Ann. Fac. Sci. Toulouse 11 4 (2002) 485-505
25. Fienberg S.E. The geometry of an r × c contingency table. Ann. Math. Statist. 39 4 (1968) 1186-1190
26. Fienberg S.E. An iterative procedure for estimation in contingency tables. Ann. Math. Statist. 41 (1970) 907-917
27. Fienberg S.E. Quasi-independence and maximum likelihood estimation in incomplete contingency tables. J. Amer. Statist. Assoc. 65 232 (1970) 1610-1616
28. Fienberg S.E. The Analysis of Cross-Classified Categorical Data. second ed (1980), MIT Press, Cambridge, MA. Reprinted 2007, Springer, New York
29. Fienberg S.E. The contributions of William Cochran to categorical data analysis. In: Rao P.S.R.S. (Ed). W. G. Cochran's Impact on Statistics (1984), Wiley, New York 103-118
30. Fienberg, S.E., 1992. Introduction to paper by M.W. Birch. In: Kotz, S., Johnson, N. (Eds.), Breakthroughs in Statistics, Methodology and Distribution, vol. II, Springer, New York, pp. 453-461.
31. Fienberg S.E. Contingency tables and log-linear models: basic results and new developments. J. Amer. Statist. Assoc. 95 (2000) 643-647
32. Fienberg S.E., and Gilbert J.P. The geometry of a two by two contingency table. J. Amer. Statist. Assoc. 65 330 (1970) 694-701
33. Fienberg S.E., and Slavkovic A.B. Making the release of confidential data from multi-way tables count. Chance 17 3 (2004) 5-10
34. 2 from contingency tables, and the calculation of p. J. Roy. Statist. Soc. 85 1 (1922) 87-94
35. Galton F. Finger Prints (1892), Macmillan, London
36. Gawrilow, E., Joswig, M., 2000. Polymake: a framework for analyzing convex polytopes. In: Polytopes, Combinatorics and Computation. Birkhauser, Boston, MA.
37. Gloneck G., Darroch J.N., and Speed T.P. On the existence of the maximum likelihood estimator for hierarchical log-linear models. Scandinavian J. Statist. 15 (1988) 187-193
38. Good I.J. Maximum entropy for hypotheses formulation especially for multidimensional contingency tables. Ann. Math. Statist. 34 (1963) 911-934
39. Goodman L.A. On methods for comparing contingency tables. J. Roy. Statist. Soc. 126 (1963) 94-108
40. Goodman L.A. Simultaneous confidence limits for cross-product ratios in contingency tables. J. Roy. Statist. Soc. 26 (1964) 86-102
41. Goodman L.A. The multivariate analysis of qualitative data: interactions among multiple classifications. J. Amer. Statist. Assoc. 65 329 (1970) 226-256
42. Goodman L.A. Partitioning of chi-square, analysis of marginal contingency tables, and estimation of expected frequencies in multidimensional contingency tables. J. Amer. Statist. Assoc. 66 334 (1971) 339-344
43. Goodman L.A. Simple models for the analysis of association in cross-classifications having ordered categories. J. Amer. Statist. Assoc. 74 (1979) 537-552
44. Goodman L.A. Association models and canonical correlation in the analysis of cross-classifications having ordered categories. J. Amer. Statist. Assoc. 76 (1981) 320-334
45. Goodman L.A. The analysis of cross-classified data having ordered and/or unordered categories: association models correlation models, and asymmetry models for contingency tables with or without missing entries. Ann. Statist. 13 (1985) 10-69
46. Goodman L.A. A single general method for the analysis of cross-classified data: reconciliation and synthesis of some methods of Pearson, Yule and Fisher, and also some methods of correspondence analysis and association analysis. J. Amer. Statist. Assoc. 91 (1996) 408-428
47. Grizzle J.E., Starmer C.F., and Koch G.G. Analysis of categorical data by linear models. Biometrics 24 (1969) 489-504
48. Haberman. The Analysis of Frequency Data (1974), University of Chicago Press, Chicago, IL
49. Haberman S.J. Log-linear fit for contingency tables-algorithm AS51. Appl. Statist. 21 (1972) 218-225
50. Haberman S.J. Log-linear models for frequency data: sufficient statistics and likelihood equations. Ann. Statist. 1 4 (1973) 617-632
51. Haberman S.J. Correction to as 51: log-linear fit for contingency tables. Appl. Statist. 25 2 (1976) 193
52. Haberman S.J. Log-linear models and frequency tables with small expected counts. Ann. Statist. 5 6 (1977) 1148-1169
53. Hastie T.J., and Pregibon D. Generalized linear models. In: Chambers J.M., and Hastie T.J. (Eds). Statistical Models in S (1991), Wadsworth & Brooks, Cole, Pacific Grove, CA
54. Heyde C.C., and Seneta E. I.J. Bienaymé: Statistical Theory Anticipated (1977), Springer, New York
55. Koch G., Amara J., Atkinson S., and Stanish W. Overview of categorical analysis methods. SAS-SUGI 8 (1983) 785-795
56. Koehler K.J. Goodness-of-fit tests for log-linear models in sparse contingency tables. J. Amer. Statist. Assoc. 81 394 (1986) 483-493
57. Lauritzen S.F. Graphical Models (1996), Oxford University Press, New York
58. Lehmann E.L., and Romano J.P. Testing Statistical Hypothesis. third ed (2005), Springer, New York
59. Mantel N., and Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J. Nat. Cancer Inst. 22 (1959) 719-748
60. McCullagh P., and Nelder J.A. Generalized Linear Models (1989), Chapman & Hall, New York
61. Morris C. Central limit theorems for multinomial sums. Ann. Statist. 3 1 (1975) 165-188
62. 2 test. In: Proceedings of the Berkeley Symposium on Mathematical Statistics. University of California Press, Berkeley, pp. 239-273.
63. Norton H.W. Calculation of chi-square for complex contingency tables. J. Amer. Statist. Assoc. 40 230 (1945) 251-258
64. Pearl J. Causality: Models, Reasoning, and Inference (2000), Cambridge University Press, New York
65. Pearson K. On the criterion that a given system of deviation from the probable in the case of a correlated system of variables is such that it can reasonably be supposed to have arisen from random sampling. Philos. Mag. 50 (1900) 59-73
66. Pearson K. Mathematical contributions to the theory of evolution XIII: on the theory of contingency and its relation to association and normal correlation. Draper's Co. Research Memoirs in Biometry Series I (1904) 1-35
67. Pearson K., and Heron D. On theories of association. Biometrika 9 (1913) 159-315
68. Pistone G., Riccomagno E., and Wynn W.P. Algebraic Statistics: Computational Commutative Algebra in Statistics (2000), Chapman & Hall, CRC, New York
69. Quetelet M. Letters Addressed to H. R. H. the Grand Duke of Saxe Coburg and Gotha on the Theory of Probabilities as Applied to the Moral and Political Sciences (translated from the French by Olinthus Gregory Downs) (1849), Charles and Edwin Layton, London
70. Rinaldo, A., 2005. Maximum likelihood estimates in large sparse contingency tables. Ph.D. Thesis, Department of Statistics, Carnegie Mellon University.
71. Roy S.N. Some Aspects of Multivariate Analysis (1957), Wiley, New York
72. Roy S.N., and Kastenbaum M.A. On the hypothesis of no "interaction" in a multi-way contingency table. Ann. Math. Statist. 27 3 (1956) 749-757
73. Roy S.N., and Mitra S.K. An introduction to some nonparametric generalizations of analysis of variance and multivariate analysis. Biometrika 43 (1956) 361-376
74. Silvapulle M.J. On the existence of maximum likelihood estimators for the binomial response models. J. Roy. Statist. Soc. 43 3 (1981) 310-313
75. Spirtes P., Glymour C., and Scheines R. Causation, Prediction, and Search. second ed (2001), MIT Press, Cambridge, MA
76. Stigler S. The missing early history of contingency tables. Ann. Fac. Sci. Toulouse 11 4 (2002) 563-573
77. Whittaker J. Graphical Models in Applied Multivariate Statistics (1990), Wiley, New York
78. Wilks S.S. The likelihood test of independence in contingency tables. Ann. Math. Statist. 6 (1935) 190-196
79. Yule G.U. On the association of attributes in statistics: with illustration from the material of the childhood society, &c. Philos. Trans. Roy. Soc. 194 (1900) 257-319