Exploiting compositionality to explore a large space of model structures

Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012

Volumn , Issue , 2012, Pages 306-315

  Grosse, Roger B ^a   Salakhutdinov, Ruslan ^b   Freeman, William T ^a   Tenenbaum, Joshua B ^c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROPRIATE MODELS; COMPOSITIONALITY; DECOMPOSITION STRUCTURES; MATRIX DECOMPOSITION; MODEL SELECTION; PREDICTIVE LIKELIHOODS; PROBABILISTIC MODELS; RE-USABLE ALGORITHMS;

COMPUTER SOFTWARE REUSABILITY; MODEL STRUCTURES;

ARTIFICIAL INTELLIGENCE;

EID: 84886001624     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. A. Barron, J. Rissanen, and B. Yu. The minimum description length principle in coding and modeling. Transactions on Information Theory, 1998.
2. P. Berkes, R. Turner, and M. Sahani. On sparsity and overcompleteness in image models. In Advances in Neural Information Processing Systems, 2008.
3. T. Bossomaier and A.W. Snyder. Why spatial frequency processing in the visual cortex? Vision Research, 26(8):1307-1309, 1986.
4. M. Collins, S. Dasgupta, and R. Schapire. A generalization of principal component analysis to the exponential family. In Neural Information Processing Systems, 2002.
5. Finale Doshi-Velez and Zoubin Ghahramani. Accelerated sampling for the Indian buffet process. In Int'l. Conf. on Machine Learning, 2009.
6. P. J. Green. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 1995.
7. T. Griffiths and Z. Ghahramani. Infinite latent feature models and the indian buffet process. Technical report, Gatsby Computational Neuroscience Unit, 2005.
8. E. Hsu, K. Pulli, and J. Popovic. Style translations for human motion. In ACM Transactions on Graphics, 2005.
9. Y. Karklin and M. S. Lewicki. Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457: 83-86, January 2008.
10. Charles Kemp and Joshua B. Tenenbaum. The discovery of structural form. PNAS, 2008.
11. Charles Kemp, Joshua B. Tenenbaum, Thomas L. Griffiths, Takeshi Yamada, and Naonori Ueda. Learning systems of concepts with an infinite relational model. In AAAI, pages 381-388, 2006.
12. T. G. Kolda and B. W. Bader. Tensor decompositions and applications. SIAM Review, 2007.
13. Pat Langley, Herbert A. Simon, and Gary L. Bradshaw. Heuristics for empirical discovery. In Knowledge Based Learning Systems. Springer-Verlag, London, UK, 1984.
14. S. Lee, V. Ganapathi, and D. Koller. Efficient structure learning of Markov networks using L1-regularization. In NIPS, 2006.
15. M. Li and P. Vitanyi. An introduction to Kolmogorov complexity and its applications. Springer, 1997.
16. S. Lyu and E. P. Simoncelli. Nonlinear extraction of independent components of natural images using radial Gaussianization. Neural Computation, 21(6):1485-1519, 2009.
17. DJC MacKay. Bayesian interpolation. Neural Computation, 1992.
18. E. Meeds, Z. Ghahramani, R. Neal, and S. T. Roweis. Modelling dyadic data with binary latent factors. In NIPS, volume 20, pages 1002-1009, 2006.
19. K. T. Miller, T. L. Griffiths, and M. I. Jordan. Nonparametric latent feature models for link prediction. In Advances in Neural Information Processing Systems, 2009.
20. S. Mohamed, K. Heller, and Z. Ghahramani. Bayesian exponential family PCA. In NIPS, 2008.
21. R. M. Neal. Annealed importance sampling. Statistics and Computing, 11(2):125-139, April 2001.
22. B. A. Olshausen and D. J. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-9, June 1996.
23. D. Pomerleau, G. E. Hinton, M. Palatucci, and T. M. Mitchell. Zero-shot learning with semantic output codes. In NIPS, 2009.
24. J. Portilla and E. P. Simoncelli. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40(1):49-71, 2000.
25. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli. Image denoising using scale mixtures of Gaussians in the wavelet domain. IEEE Transactions on Signal Processing, 12(11): 1338-1351, 2003.
26. Sam Roweis and Zoubin Ghahramani. A unifying review of linear gaussian models. In Neural Computation, volume 11, pages 305-345, 1999.
27. Ruslan Salakhutdinov and Andriy Mnih. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems, 2008.
28. Ruslan Salakhutdinov and Iain Murray. On the quantitative analysis of deep belief networks. In Int'l. Conf. on Machine Learning, 2008.
29. Ajit P. Singh and Geoffrey J. Gordon. A unified view of matrix factorizations. In European Conference on Machine Learning, 2008.
30. N. Srebro. Learning with matrix factorizations. PhD thesis, MIT, 2004.
31. I. Sutskever, R. Salakhutdinov, and J. B. Tenenbaum. Modelling relational data using Bayesian clustered tensor factorization. In NIPS, pages 1821-1828. 2009.
32. Graham W. Taylor, Geoffrey E. Hinton, and Sam Roweis. Modeling human motion using binary latent variables. In NIPS, 2007.
33. M. Teyssier and D. Koller. Ordering-based search: a simple and effective algorithm for learning Bayesian networks. In UAI, 2005.
34. Ljupco Todorovski and Saso Dzeroski. Declarative bias in equation discovery. In Int'l. Conf. on Machine Learning, 1997.
35. C.S. Wallace. Statistical and inductive inference by minimum message length. Springer, 2005.