Learning generative models with visual attention

Advances in Neural Information Processing Systems

Volumn 2, Issue January, 2014, Pages 1808-1816

  Tang, Yichuan ^a   Srivastava, Nitish ^a   Salakhutdinov, Ruslan ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE SEGMENTATION; INFORMATION SCIENCE;

ATTENTION MODEL; ATTENTIONAL MECHANISM; BACKGROUND CLUTTER; CANONICAL REPRESENTATIONS; GENERATIVE MODEL; REGION OF INTEREST; SENSORY STIMULUS; VISUAL ATTENTION;

BEHAVIORAL RESEARCH;

EID: 84937843152     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. G. E. Hinton, S. Osindero, and Y. W. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18(7): 1527-1554, 2006.
2. R. Salakhutdinov and G. Hinton. Deep Boltzmann machines. In AISTATS, 2009.
3. Geoffrey E. Hinton, Peter Dayan, and Michael Revow. Modeling the manifolds of images of handwritten digits. IEEE Transactions on Neural Networks, 8(1): 65-74, 1997.
4. Daniel Zoran and Yair Weiss. From learning models of natural image patches to whole image restoration. In ICCV. IEEE, 2011.
5. Yoshua Bengio, Li Yao, Guillaume Alain, and Pascal Vincent. Generalized denoising auto-encoders as generative models. In Advances in Neural Information Processing Systems 26, 2013.
6. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, pages 609-616, 2009.
7. Marc'Aurelio Ranzato, Joshua Susskind, Volodymyr Mnih, and Geoffrey Hinton. On Deep Generative Models with Applications to Recognition. In CVPR, 2011.
8. Yichuan Tang, Ruslan Salakhutdinov, and Geoffrey E. Hinton. Deep mixtures of factor analysers. In ICML. icml.cc / Omnipress, 2012.
9. M. I. Posner and C. D. Gilbert. Attention and primary visual cortex. Proc. of the National Academy of Sciences, 96(6), March 1999.
10. E. A. Buffalo, P. Fries, R. Landman, H. Liang, and R. Desimone. A backward progression of attentional effects in the ventral stream. PNAS, 107(1): 361-365, Jan. 2010.
11. N Kanwisher and E Wojciulik. Visual attention: Insights from brain imaging. Nature Reviews Neuroscience, 1: 91-100, 2000.
12. C. H. Anderson and D. C. Van Essen. Shifter circuits: A computational strategy for dynamic aspects of visual processing. National Academy of Sciences, 84: 6297-6301, 1987.
13. B. A. Olshausen, C. H. Anderson, and D. C. Van Essen. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. The Journal of neuroscience: the official journal of the Society for Neuroscience, 13(11): 4700-4719, 1993.
14. Laurenz Wiskott. How does our visual system achieve shift and size invariance?, 2004.
15. S. Chikkerur, T. Serre, C. Tan, and T. Poggio. What and where: a Bayesian inference theory of attention. Vision Research, 50(22): 2233-2247, October 2010.
16. J. K. Tsotsos, S. M. Culhane, W. Y. K. Wai, Y. H. Lai, N. Davis, and F. Nuflo. Modeling visual-attention via selective tuning. Artificial Intelligence, 78(1-2): 507-545, October 1995.
17. Hugo Larochelle and Geoffrey E. Hinton. Learning to combine foveal glimpses with a third-order boltzmann machine. In NIPS, pages 1243-1251. Curran Associates, Inc., 2010.
18. D. P. Reichert, P. Seriès, and A. J. Storkey. A hierarchical generative model of recurrent object-based attention in the visual cortex. In ICANN (1), Volume 6791, pages 18-25. Springer, 2011.
19. B. Alexe, N. Heess, Y. W. Teh, and V. Ferrari. Searching for objects driven by context. In NIPS 2012, December 2012.
20. Marc'Aurelio Ranzato. On learning where to look. arXiv, arXiv: 1405.5488, 2014.
21. M. Denil, L. Bazzani, H. Larochelle, and N. de Freitas. Learning where to attend with deep architectures for image tracking. Neural Computation, 28: 2151-2184, 2012.
22. G. E. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313: 504-507, 2006.
23. A. Krizhevsky. Learning multiple layers of features from tiny images, 2009.
24. Graham W. Taylor, Rob Fergus, Yann LeCun, and Christoph Bregler. Convolutional learning of spatiotemporal features. In ECCV 2010. Springer, 2010.
25. A. Mohamed, G. Dahl, and G. Hinton. Acoustic modeling using deep belief networks. IEEE Transactions on Audio, Speech, and Language Processing, 2011.
26. Richard Szeliski. Computer Vision - Algorithms and Applications. Texts in Computer Science. Springer, 2011.
27. S. Duane, A. D. Kennedy, B. J Pendleton, and D. Roweth. Hybrid Monte Carlo. Physics Letters B, 195(2): 216-222, 1987.
28. R. M. Neal. MCMC using Hamiltonian dynamics. In Handbook of Markov Chain Monte Carlo (eds S. Brooks, A. Gelman, G. Jones, XL Meng). Chapman and Hall/CRC Press, 2010.
29. Simon Baker and Iain Matthews. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision, 56: 221-255, 2002.
30. Ralph Gross, Iain Matthews, Jeffrey F. Cohn, Takeo Kanade, and Simon Baker. Multi-pie. Image Vision Comput., 28(5): 807-813, 2010.
31. J. P. Lewis. Fast normalized cross-correlation, 1995.
32. T. Tieleman and G. E. Hinton. Using fast weights to improve persistent contrastive divergence. In ICML, Volume 382, page 130. ACM, 2009.
33. R. Salakhutdinov and I. Murray. On the quantitative analysis of deep belief networks. In Proceedings of the Intl. Conf. on Machine Learning, Volume 25, 2008.