Learning parts-based representations with nonnegative restricted boltzmann machine

Journal of Machine Learning Research

Volumn 29, Issue , 2013, Pages 133-148

  Nguyeny, Tu Dinh ^a   Tranyz, Truyen ^a,b   Phungy, Dinh ^a   Venkateshy, Svetha ^a  

^a DEAKIN UNIVERSITY   (Australia)

^b CURTIN UNIVERSITY   (Australia)

Author keywords

Learning representation; Nonnegative; Parts based representation; Restricted boltzmann machines; Semantic features

Indexed keywords

LEARNING REPRESENTATION; NON NEGATIVES; PARTS-BASED REPRESENTATION; RESTRICTED BOLTZMANN MACHINE; SEMANTIC FEATURES;

EID: 84908495946     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (23)

1. Shivani Agarwal, Aatif Awan, and Dan Roth. Learning to detect objects in images via a sparse, partbased representation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 26(11):1475-1490, 2004.
2. AT&T at Cambridge. The ORL Database of Faces, AT&T Laboratories of Cambridge. URL http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html.
3. Yoshua Bengio, Aaron Courville, and Pascal Vincent. Representation learning: A review and new perspectives. arXiv preprint arXiv:1206.5538, 2012.
4. David M Blei, Andrew Y Ng, and Michael Jordan. Latent dirichlet allocation. The Journal of Machine Learning Research (JMLR), 3:993-1022, 2003.
5. Deng Cai, Xiaofei He, and Jiawei Han. Document clustering using locality preserving indexing. IEEE Transactions on Knowledge and Data Engineering (TKDE), 17(12):1624-1637, December 2005.
6. CBCL at MIT. CBCL Face Database #1, MIT Center For Biological and Computation Learning. URL http://cbcl.mit.edu/software-datasets/FaceData2.html.
7. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2:27:1-27:27, 2011. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
8. David Donoho and Victoria Stodden. When does non-negative matrix factorization give a correct decomposition into parts? In Advances in Neural Information Processing Systems (NIPS), 2003.
9. Yoav Freund and David Haussler. Unsupervised learning of distributions on binary vectors using two layer networks. Technical report, Santa Cruz, CA, USA, 1994.
10. P.V. Gehler, A.D. Holub, and M. Welling. The rate adapting Poisson model for information retrieval and object recognition. In Proceedings of the 23rd International Conference on Machine Learning (ICML), pages 337-344. ACM, 2006.
11. Zoubin Ghahramani and Thomas L Griffiths. Infinite latent feature models and the Indian buffet process. In Advances in Neural Information Processing Systems (NIPS), pages 475-482, 2005.
12. Geoffrey Hinton and Ruslan Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504 - 507, 2006.
13. Geoffrey E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002.
14. Geoffrey E Hinton. A practical guide to training restricted Boltzmann machines. In Neural Networks: Tricks of the Trade, pages 599-619. Springer, 2012.
15. Geoffrey E Hinton and Zoubin Ghahramani. Generative models for discovering sparse distributed representations. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 352(1358):1177-1190, 1997.
16. Patrik O Hoyer. Non-negative matrix factorization with sparseness constraints. The Journal of Machine Learning Research (JMLR), 5:1457-1469, 2004.
17. Yann Lecun, Corinna Cortes, and Christopher J.C. Burges. The MNIST database of handwritten digits. URL http://yann.lecun.com/exdb/mnist/.
18. Daniel D Lee and H Sebastian Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755):788-791, 1999.
19. Andre Lemme, René Felix Reinhart, and Jochen Jakob Steil. Online learning and generalization of parts-based image representations by non-negative sparse autoencoders. Neural Networks, 33(0): 194 - 203, 2012. ISSN 0893-6080.
20. Jorge Nocedal and Stephen J. Wright. Numerical Optimization. Springer, August 2000, pp. 497-506. ISBN 0387987932.
21. P. Smolensky. Parallel distributed processing: Explorations in the microstructureof cognition, vol. 1. chapter Information processing in dynamical systems: Foundations of harmony theory, pages 194-281. MIT Press, Cambridge, MA, USA, 1986. ISBN 0-262-68053-X.
22. Yee Whye Teh and Geoffrey E Hinton. Rate-coded restricted Boltzmann machines for face recognition. Advances in Neural Information Processing Systems (NIPS), pages 908-914, 2001.
23. L. vanderMaaten and G. Hinton. Visualizing data using t-SNE. The Journal of Machine Learning Research (JMLR), 9(Nov):2579-2605, 2008.