A Statistically Efficient and Scalable Method for Log-Linear Analysis of High-Dimensional Data

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn 2015-January, Issue January, 2014, Pages 480-489

  Petitjean, Francois ^a   Allison, Lloyd ^a   Webb, Geoffrey I ^a  

^a MONASH UNIVERSITY   (Australia)

Author keywords

Association discovery; Data modeling; Graphical models; High dimensional data; Information theory; Log linear Analysis; Statistical inference

Indexed keywords

CLUSTERING ALGORITHMS; COMPUTATIONAL EFFICIENCY; DATA MINING; DATA STRUCTURES; EFFICIENCY; INFORMATION THEORY; SCALABILITY; STATISTICS;

ASSOCIATION DISCOVERIES; GRAPHICAL MODEL; HIGH DIMENSIONAL DATA; LOG-LINEAR ANALYSIS; STATISTICAL INFERENCE;

QUALITY CONTROL;

EID: 84936937505     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2014.23     Document Type: Conference Paper

References (28)

1. R. Agrawal and R. Srikant, "Fast algorithms for mining association rules in large databases, " in Int. Conf. on Very Large Data Bases, 1994, pp. 487-499.
2. G. I. Webb, "Discovering significant patterns, " Machine Learning, vol. 68, no. 1, pp. 1-33, 2007.
3. M. J. Zaki, S. Parthasarathy, M. Ogihara, and W. Li, " New algorithms for fast discovery of association rules," in Int. Conf. on Knowledge Discovery and Data Mining, 1997, pp. 283-286.
4. H. Heikinheimo, J. K. Seppänen, E. Hinkkanen, H. Mannila, and T. Mielikäinen, " Finding low-entropy sets and trees from binary data," in Int. Conf. on Knowledge Discovery and Data Mining, 2007, pp. 350-359.
5. M. Mampaey and J. Vreeken, "Summarizing categorical data by clustering attributes, " Data Mining and Knowledge Discovery, vol. 26, no. 1, pp. 130-173, 2013.
6. F. Petitjean, G. I. Webb, and A. E. Nicholson, "Scaling loglinear analysis to high-dimensional data," in IEEE Int. Conf. on Data Mining, 2013, pp. 597-606.
7. S. J. Haberman, The analysis of frequency data. University of Chicago Press, 1974.
8. C. S. Wallace, Statistical and Inductive Inference by Minimum Message Length, ser. Information Science and Statistics. Springer-Verlag, 2005.
9. R. Christensen, Log-Linear Models and Logistic Regression Second Edition. Springer, 1997.
10. F. Malvestuto, " Approximating discrete probability distributions with decomposable models," IEEE Transactions on Systems, Man and Cybernetics, vol. 21, no. 5, pp. 1287-1294, 1991.
11. S. Altmueller and R. M. Haralick, "Approximating high dimensional probability distributions, " in IEEE Int. Conf. on Pattern Recognition, 2004, pp. 299-302.
12. P. Heggernes, "Minimal triangulations of graphs: A survey, " Discrete Mathematics, vol. 306, no. 3, pp. 297-317, 2006.
13. A. Deshpande, M. Garofalakis, and M. I. Jordan, " Efficient stepwise selection in decomposable models," in Uncertainty in Artificial Intel., 2001, pp. 128-135.
14. S. E. Fienberg and A. Rinaldo, "Maximum likelihood estimation in log-linear models, " Annals of Statistics, vol. 40, no. 2, pp. 996-1023, 2012.
15. J. H. McDonald, Handbook of Biological Statistics. Sparky House Pub., 2009, ch. Tests for nominal variables, pp. 80-83.
16. C. S. Wallace and D. M. Boulton, "An information measure for classification, " The Computer Journal, vol. 11, no. 2, pp. 185-194, 1968.
17. J. Rissanen, "Mode ling by shortest data description," Automatica, vol. 14, no. 5, pp. 465-471, 1978.
18. A. N. Kolmogorov, "Three approaches to the quantitative definition of information, " Problemy Peredachi Inform atsii, vol. 1, no. 1, pp. 3-11, 1965.
19. D. Boulton and C. Wallace, "The information content of a multistate distribution, " Journal of Theoretical Biology, vol. 23, no. 2, pp. 269-278, 1969.
20. A. Berry, A. Sigayret, and C. Sinoquet, "Maximal subtriangulation in pre-processing phylogenetic data, " Soft Computi ng, vol. 10, no. 5, pp. 461-468, 2006.
21. X. Wu, D. Barbará , and Y. Ye, " Screening and interpreting multi-item associations based on log-linear modeling," in Int. Conf. on Knowledge Disc. and Data Mining, 2003, pp. 276-285.
22. C. Dahinden,M. Kalisch,P. Bühlmann Decomposition and model selection for large contingency tables Biometrical Journal 52, 2, 233-252, 2010
23. M. J. Wainwright, P. Ravikumar, and J. D. Lafferty, " Highdimensional graphical model selection using1-regularized logistic regression," in Advances in Neural Information Processing Systems, 2007, pp. 1465-1472.
24. S.-I. Lee, V. Ganapathi, and D. Koller, "Efficient Structure Learning of Markov Networks using-1-Regularization, " in Advances in neural in formation processing systems, 2006, pp. 817-824.
25. V. Gogate, W. A. Webb, and P. Domingos, "Learning Efficient Markov Networks, " in Advances in Neural Information Processing Systems, 2010, pp. 748-756.
26. V. E. Johnson, "Revised standards for statistical evidence, " Proc. of the National Academy of Sciences of the USA, vol. 110, no. 48, pp. 19 313-19 317, 2013.
27. J. Taylor, R. Wallace, A. Ostfeld, and D. Blazer, " Established Populations for Epidemiologic Studies of the Elderly, 1981-1993," 1998, http://dx.doi.org/10.3886/ICPSR09915.
28. J. Flores, A. E. Nicholson, A. Brunskill, K. B. Korb, and S. Mascaro, " Incorporating expert knowledge when learning Bayesian network structure," Artificial Intelligence in Medicine, vol. 53, no. 3, pp. 181-204, 2011.