On sparse, spectral and other parameterizations of binary probabilistic models

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 173-181

  Buchman, David ^a   Schmidt, Mark ^b   Mohamed, Shakir ^a   Poole, David ^a   De Freitas, Nando ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; HIGHER ORDER STATISTICS; PARAMETERIZATION;

EMPIRICAL - COMPARISONS; HARMONIC EXPANSION; LOGLINEAR MODEL; PROBABILISTIC MODELS; REFERENCE STATE; SPECTRAL INTERPRETATION; STRUCTURAL LEARNING; UNDERLYING DISTRIBUTION;

PROBABILITY DISTRIBUTIONS;

EID: 84891371696     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (24)

1. Pieter Abbeel, Daphne Koller, and Andrew Y. Ng. Learning factor graphs in polynomial time and sample complexity. Journal of Machine Learning Research, 7:1743-1788, 2006.
2. Tom Beer. Walsh transforms. American Journal of Physics, 49(5):466-472, 1981.
3. Yvonne M. Bishop, Stephen E. Fienberg, and Paul W. Holland. Discrete multivariate analysis: Theory and practice. MIT Press, 1975.
4. Emmanuel Candes, Justin Romberg, and Terence Tao. Stable signal recovery from incomplete and inaccurate measurements. Communications on Pure and Applied Mathematics, 59(8):1207-1223, 2006.
5. Corinne Dahinden, Giovanni Parmigiani, Mark C. Em-erick, and P. Peter Buhlmann. Penalized likelihood for sparse contingency tables with an application to full-length cDNA libraries. BMC Bioinformatics, 8: 476, 2007.
6. Shilin Ding, Grace Wahba, and Jerry Xiaojin Zhu. Learning higher-order graph structure with features by structure penalty. Neural Information Processing Systems, 2011.
7. David Edwards and Tomas Havranek. A fast procedure for model search in multidimensional contingency tables. Biometrika, 72(2):339-351, 1985.
8. Andre Elisseeff and Jason Weston. Kernel methods for multi-labelled classification and categorical regression problems. In Neural Information Processing Systems, 2002.
9. Elena A. Erosheva, Stephen E. Fienberg, and Cyrille Joutard. Describing disability through individual-level mixture models for multivariate binary data. Annals of Applied Statistics, 1(2):502-537, 2007.
10. Ken Goldberg, Theresa Roeder, Dhruv Gupta, and Chris Perkins. Eigentaste: A constant time collaborative filtering algorithm. Inf. Retrieval, 4(2):133-151, 2001.
11. Ali Jalali, Pradeep Ravikumar, Vishvas Vasuki, and Sujay Sanghavi. On learning discrete graphical models using group-sparse regularization. In AISTATS. 2010.
12. Masashi Kato, Qian Ji Gao, Hiroshi Chigira, Hiroyuki Shindo, and Masato Inoue. A haplotype inference method based on sparsely connected multi-body Ising model. Journal of Physics: Conference Series, 233(1), 2010.
13. Daphne Koller and Nir Friedman. Probabilistic graphical models: Principles and techniques. MIT Press, 2009.
14. Steffen L. Lauritzen. Graphical models. Oxford University Press, USA, 1996.
15. Su-In Lee, Varun Ganapathi, and Daphne Koller. Efficient structure learning of Markov networks using Li-regularization. Neural Information Processing Systems, 2006.
16. Mohammad Maqusi. Walsh series expansions of probability distributions. IEEE Transactions on Electromagnetic Compatibility, 23(4):401-407, 1981.
17. W.K. Pratt, J. Kane, and H.C. Andrews. Hadamard transform image coding. Proceedings of the IEEE, 57(1):58-68, 1969.
18. Pradeep Ravikumar, Martin J. Wainwright, and John D. Lafferty. High-dimensional Ising model selection using ℓ-regularized logistic regression. Annals of Statistics, 38(3):1287-1319, 2010.
19. Daniel N. Rockmore. Some applications of generalized FFTs. In Proceedings of the 1995 DIMACS Workshop on Groups and Computation, pages 329-369. June, 1997.
20. Sam Roweis. USPS data. http://cs.nyu.edu/~roweis/data.html.
21. Karen Sachs, Omar Perez, Dana Pe'er, Doug Lauffen-Burger, and Garry Nolan. Causal protein-signaling networks derived from multiparameter single-cell data. Science, 308(5721):523-529, 2005.
22. Mark Schmidt and Kevin P. Murphy. Convex structure learning in log-linear models: Beyond pairwise potentials. Artificial Intelligence and Statistics, 2010.
23. Larry Wasserman. All ofstatistics. Springer, 2004.
24. Joe Whittaker. Graphical models in applied multivari-ate analysis. John Wiley and Sons, 1990.