Multiresolution deep belief networks

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 1203-1211

  Tang, Yichuan ^a   Mohamed, Abdel Rahman ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

DEEP BELIEF NETWORK (DBN); DEEP BELIEF NETWORKS; DIFFERENT STRUCTURE; FINE RESOLUTION; MULTIRESOLUTION; MULTISCALE REPRESENTATIONS; PHONE RECOGNITION; VISUAL PHENOMENA;

BAYESIAN NETWORKS;

EID: 84954198849     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (31)

1. G. E. Hinton, S. Osindero, and Y. W. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527-1554, 2006.
2. R. Salakhutdinov and G. Hinton. Deep Boltzmann machines. In AISTATS, 2009.
3. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layer-wise training of deep networks. In Adv. in Neural Information Processing Systems 19, pages 153-160, 2007.
4. R. Salakhutdinov and H. Larochelle. Efficient learning of deep boltzmann machines. AISTATS, 2010.
5. A. Mohamed, G. E. Dahl, and G. E. Hinton. Deep belief networks for phone recognition. In NIPS Workshop on Deep Learning for Speech Recognition and Related Applications, 2009.
6. G. E. Dahl, M. Ranzato, A. Mohamed, and G. E. Hinton. Phone recognition with the mean-covariance restricted Boltzmann machine. In NIPS 23. 2010.
7. M. Ranzato, J. Susskind, V. Mnih, and G. E. Hinton. On deep generative models with applications to recognition. CVPR, 2011.
8. T. Lindeberg. Scale-Space Theory in Computer Vision. Kluwer, December 1993.
9. W. Zhang, G. Zelinsky, and D. Samaras. Real-time accurate object detection using multiple resolutions. In ICCV, 2007.
10. Y. Amit, D. Geman, and X. Fan. A coarse-to-fine strategy for multi-class shape detection. IEEE Transactions PAMI, 26(12), 2004.
11. D. G. Lowe. Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60:91-110, 2004.
12. T. F. Cootes, C. J. Taylor, and A. Lantis. Active Shape Models: Evaluation of Multi-Resolution Method for Improving Image Search. In BMVC, 1994.
13. C. H. Anderson, J. R. Bergen, P. J. Burt, and J. M. Ogden. Pyramid Methods in Image Processing, 1984.
14. G. E. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313:504-507, 2006.
15. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14:1771-1800, 2002.
16. T. Tieleman and G. E. Hinton. Using fast weights to improve persistent contrastive divergence. In ICML, volume 382, page 130. ACM, 2009.
17. A. Krizhevsky. Learning multiple layers of features from tiny images, 2009.
18. G. Taylor, G. E. Hinton, and S. Roweis. Modeling human motion using binary latent variables. In NIPS, 2006.
19. H. Lee, C. Ekanadham, and A. Ng. Sparse deep belief net model for visual area V2. In NIPS, 2007.
20. M. Ranzato and G. Hinton. Modeling pixel means and covariances using factorized third-order boltzmann machines. CVPR, 2010.
21. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In Proceedings of ICML, 2010.
22. A. Courville, J. Bergstra, and Y. Bengio. A spike and slab restricted boltzmann machine. In Proceedings of AISTATS, 2011.
23. P. Burt and T. Adelson. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications, 31:532-540, 1983.
24. J.M. Susskind. The Toronto Face Database. Technical report, 2011. http://aclab.ca/users/josh/TFD. html.
25. Y. LeCun, F. Huang, and L. Bottou. Learning methods for generic object recognition with invariance to pose and lighting. In Proceedings of CVPR'04. IEEE Press, 2004.
26. V. Nair and G. E. Hinton. 3-D object recognition with deep belief nets. In NIPS 22, 2009.
27. L. Quoc, J. Ngiam, Z. Chen, D. Chia, P. W. Koh, and A. Ng. Tiled convolutional neural networks. In NIPS 23. 2010.
28. P. Sinha, B. Balas, Y. Ostrovsky, and R. Russell. Face recognition by humans: Nineteen results all computer vision researchers should know about. Proceedings of the IEEE, 94(11):1948-1962, 2006.
29. A. Mohamed, G. Dahl, and G. Hinton. Acoustic modeling using deep belief networks. IEEE Transactions on Audio, Speech, and Language Processing, 2011.
30. K.-F. Lee and H.-W. Hon. Speaker-Independent Phone Recognition Using Hidden Markov Models, volume CMU-CS-88-121. CMU Computer Science Dept., Mar. 31, 1988.
31. A. Mohamed, T. N. Sainath, G. E. Dahl, B. Ramabhadran, G. E. Hinton, and M. A. Picheny. Deep belief networks using discriminative features for phone recognition. pages 5060-5063. ICASSP, 2011.