Learning the structure of deep sparse graphical models

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 1-8

  Adams, Ryan Prescott ^a   Wallach, Hanna M ^b   Ghahramani, Zoubin ^c  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP BELIEF NETWORKS; GAUSSIANS; GRAPHICAL MODEL; HIDDEN LAYERS; HIDDEN UNITS; IMAGE DATA; MARKOV CHAIN MONTE CARLO; MODEL COMPLEXES; NON-PARAMETRIC BAYESIAN;

ARTIFICIAL INTELLIGENCE; PROBABILITY DISTRIBUTIONS;

BAYESIAN NETWORKS;

EID: 84862281026     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (26)

1. M. J. Beal and Z. Ghahramani. Variational Bayesian learning of directed graphical models with hidden variables. Bayesian Analysis, 1(4):793-832, 2006.
2. W. Buntine. Theory refinement on Bayesian networks. In 7th Conference on Uncertainty in Artificial Intelligence, 1991.
3. A. C. Courville, D. Eck, and Y. Bengio. An infinite factor model hierarchy via a noisy-or mechanism. In Advances in Neural Information Processing Systems 22, 2009.
4. G. Elidan, N. Lotner, N. Friedman, and D. Koller. Discovering hidden variables. In Advances in Neural Information Processing Systems 13, 2000.
5. G. Fayolle, V. A. Malyshev, and M. V. Menshikov. Topics in the Constructive Theory of Countable Markov Chains. Cambridge University Press, Cambridge, UK, 2008.
6. E. B. Fox, E. B. Sudderth, M. I. Jordan, and A. S. Willsky. Sharing features among dynamical systems with beta processes. In Advances in Neural Information Processing Systems 22, 2009.
7. B. J. Frey. Continuous sigmoidal belief networks trained using slice sampling. In Advances in Neural Information Processing Systems 9, 1997.
8. B. J. Frey and G. E. Hinton. Variational learning in nonlinear Gaussian belief networks. Neural Computation, 11 (1):193-213, 1999.
9. N. Friedman. The Bayesian structural EM algorithm. In 14th Conference on Uncertainty in Artificial Intelligence, 1998.
10. N. Friedman and D. Koller. Being Bayesian about network structure. Machine Learning, 50(1-2):95-125, 2003.
11. Z. Ghahramani, T. L. Griffiths, and P. Sollich. Bayesian nonparametric latent feature models. In Bayesian Statistics 8, pages 201-226. 2007.
12. T. L. Griffiths and Z. Ghahramani. Infinite latent feature models and the Indian buffet process. In Advances in Neural Information Processing Systems 18, 2006.
13. D. Heckerman, D. Geiger, and D. M. Chickering. Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20(3):197-243, 1995.
14. G. E. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313 (5786):504-507, 2006.
15. G. E. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18 (7):1527-1554, July 2006.
16. M. Koivisto and K. Sood. Exact Bayesian structure discovery in Bayesian networks. Journal of Machine Learning Research, 5:549-573, 2004.
17. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
18. J. S. Liu, F. Liang, and W. H. Wong. The use of multipletry method and local optimization in Metropolis sampling. Journal of the American Statistical Association, 95(449):121-134, 2000.
19. D. J. C. MacKay. Bayesian neural networks and density networks. Nuclear Instruments and Methods in Physics Research, Section A, 354(1):73-80, 1995.
20. R. M. Neal. Connectionist learning in belief networks. Artificial Intelligence, 56:71-113, July 1992.
21. J. Pearl. Probabalistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, CA, 1988.
22. S. Ramachandran and R. J. Mooney. Theory refinement of Bayesian networks with hidden variables. In 15th International Conference on Machine Learning, 1998.
23. F. S. Samaria and A. C. Harter. Parameterisation of a stochastic model for human face identification. In 2nd IEEE Workshop on Applications of Comp. Vision, 1994.
24. E. Seneta and D. Vere-Jones. On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states. Journal of Applied Probability, 3 (2):403-434, December 1966.
25. Y.-W. Teh, D. Görür, and Z. Ghahramani. Stick-breaking construction for the Indian buffet process. In 11th International Conference on Artificial Intelligence and Statistics, 2007.
26. F. Wood, T. L. Griffiths, and Z. Ghahramani. A nonparametric Bayesian method for inferring hidden causes. In 22nd Conference on Uncertainty in Artificial Intelligence, 2006.