Deep exponential families

Journal of Machine Learning Research

Volumn 38, Issue , 2015, Pages 762-771

  Ranganath, Rajesh ^a   Tang, Linpeng ^a   Charlin, Laurent ^b   Blei, D Laur ^b  

^a PRINCETON UNIVERSITY   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EQUIVALENCE CLASSES; VARIATIONAL TECHNIQUES;

DEEP NEURAL NETWORKS; EXPONENTIAL FAMILY; HIDDEN STRUCTURES; LATENT VARIABLE; LATENT VARIABLE MODELS; PREDICTIVE PERFORMANCE; STATE OF THE ART; VARIATIONAL INFERENCE;

ARTIFICIAL INTELLIGENCE;

EID: 84954313610     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (40)

1. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. Pattern Analysis and Machine Intelligence, 35 (8), 2013.
2. C. Bishop. Pattern Recognition and Machine Learn-ing. Springer New York., 2006.
3. D. Blei and J. Lafferty. Dynamic topic models. In International Conference on Machine Learning, 2006.
4. D. Blei and J. Lafferty. A correlated topic model of Science. Annals of Applied Stat., 1 (1): 17-35, 2007.
5. D. Blei, T. Griffiths, M. Jordan, and J. Tenenbaum. Hierarchical topic models and the nested Chinese restaurant process. In NIPS, 2003.
6. D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3: 993-1022, January 2003.
7. L. Brown. Fundamentals of Statistical Exponential Families. Institute of Mathematical Statistics, 1986.
8. W. Buntine and A. Jakulin. Applying discrete PCA in data analysis. In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, pages 59-66. AUAI Press, 2004.
9. J. Canny. GaP: A factor model for discrete data. In Proceedings of the 27th Annual International ACM SI-GIR Conference on Research and Development in In-formation Retrieval, 2004.
10. A. Gelman and J. Hill. Data Analysis Using Regres-sion and Multilevel/Hierarchical Models. Cambridge Univ. Press, 2007.
11. Andrew Gelman, John B Carlin, Hal S Stern, David B Dunson, Aki Vehtari, and Donald B Rubin. Bayesian data analysis. CRC press, 2013.
12. I. Goodfellow, A. Courville, and Y. Bengio. Largescale feature learning with spike-and-slab sparse coding. In International Conference on Machine Learning (ICML), 2012.
13. P. Gopalan, J. Hoffman, and D. Blei. Scalable recommendation with poisson factorization. arXiv, (1311.1704), 2013.
14. Daniel Hernández-Lobato, José Miguel Hernández-Lobato, and Pierre Dupont. Generalized spike-andslab priors for bayesian group feature selection using expectation propagation. The Journal of Machine Learning Research, 14 (1): 1891-1945, 2013.
15. G. Hinton, S. Osindero, and Y. Teh. A fast learning algorithm for deep belief nets. Neural Comput., 18 (7): 1527-1554, July 2006. ISSN 0899-7667.
16. H. Ishwaran and S. Rao. Spike and slab variable selection: Frequentist and Bayesian strategies. The Annals of Statistics, 33 (2): 730-773, 2005.
17. Kalervo Järvelin and Jaana Kekäläinen. Ir evaluation methods for retrieving highly relevant documents. In In International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '00, pages 41-48. ACM, 2000. ISBN 1-58113-226-3.
18. M. Jordan, Z. Ghahramani, T. Jaakkola, and L. Saul. Introduction to variational methods for graphical models. Machine Learning, 37: 183-233, 1999.
19. Hugo Larochelle and Stanislas Lauly. A neural autoregressive topic model. In Neural Information Pro-cessing Systems, 2012.
20. D. Lee and H. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401 (6755): 788-791, October 1999.
21. W. Li and A. McCallum. Pachinko allocation: DAGstuctured mixture models of topic correlations. In ICML, 2006.
22. Benjamin Marlin. Collaborative filtering: A machine learning perspective. Technical report, University of Toronto, 2004.
23. A. Mnih and K. Gregor. Neural variational inference and learning in belief networks. In ICML, 2014.
24. S. Mohamed, K. Heller, and Z. Ghahramani. Bayesian exponential family PCA. In NIPS, 2008.
25. R. Neal. Learning stochastic feedforward networks. Tech. Rep. CRG-TR-90-7: Department of Computer Science, University of Toronto, 1990.
26. J. A. Nelder and R. W. M. Wedderburn. Generalized linear models. Journal of the Royal Statistical Society. Series A (General), 135: 370-384, 1972.
27. R. Ranganath, S. Gerrish, and D. Blei. Black box variational inference. In International Conference on Artifical Intelligence and Statistics, 2014.
28. D. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. ArXiv e-prints, January 2014.
29. H. Robbins and S. Monro. A stochastic approximation method. The Annals of Mathematical Statistics, 22 (3): pp. 400-407, 1951.
30. R. Salakhutdinov and G. Hinton. Deep boltzmann machines. In AISTATS, pages 448-455, 2009.
31. R. Salakhutdinov and A. Mnih. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In International Conference on Machine learn-ing, 2008.
32. R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In Neural Information Processing Sys-tems, 2008.
33. Ruslan Salakhutdinov and Geoffrey Hinton. Replicated softmax: an undirected topic model. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1607-1614. 2009.
34. T. Salimans and D. Knowles. Fixed-form variational posterior approximation through stochastic linear regression. Bayesian Analysis, 8 (4): 837-882, 2013.
35. L. Saul, T. Jaakkola, and M. Jordan. Mean field theory for sigmoid belief networks. Journal of Artifficial Intelligence Research, 4: 61-76, 1996.
36. P. Smolenksy. Information processing in dynamical systems: Foundations of harmony theory. Par-allel Distributed Processing: Explorations in the Mi-crostructure of Cognition, 1, 1986.
37. Nitish Srivastava, Ruslan Salakhutdinov, and Geoffrey Hinton. Modeling documents with a deep boltzmann machine. In UAI, 2013.
38. H. Wallach, I. Murray, R. Salakhutdinov, and D. Mimno. Evaluation methods for topic models. In International Conference on Machine Learning (ICML), 2009.
39. M. Welling, M. Rosen-Zvi, and G. Hinton. Exponential family harmoniums with an application to information retrieval. In Neural Information Processing Systems (NIPS) 17, 2004.
40. D. Wingate and T Weber. Automated variational inference in probabilistic programming. ArXiv e-prints, January 2013.