Thurstonian Boltzmann machines: Learning from multiple inequalities

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 705-713

  Tran, Truyen ^a,b   Phung, Dinh ^a   Venkatesh, Svetha ^a  

^a DEAKIN UNIVERSITY   (Australia)

^b CURTIN UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

BOLTZMANN MACHINES; CONTINUOUS VARIABLES; DATA INPUT; DISCRETE DATA; GAUSSIANS; HANDWRITTEN DIGIT RECOGNITION; SOCIAL SURVEY; UNIFIED ARCHITECTURE;

LEARNING SYSTEMS;

EID: 84897481062     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. JR Ashford and RR Sowden. Multi-variate probit analysis. Biometrics, pages 535-546, 1970.
2. U. Böckenholt. Thurstonian-based analyses: past, present, and future utilities. Psychometrika, 71(4):615-629, 2006.
3. O. Chapelle, D. Metlzer, Y. Zhang, and P. Grinspan. Expected reciprocal rank for graded relevance. In CIKM, pages 621-630. ACM, 2009.
4. S. Chib and E. Greenberg. Analysis of multivariate probit models. Biometrika, 85(2):347-361, 1998.
5. O. B. Downs, D.J.C. MacKay, and D.D. Lee. The nonnegative Boltzmann machine. Advances in Neural Information Processing Systems, 12:428-434, 2000.
6. D. B. Dunson and A.H. Herring. Bayesian latent variable models for mixed discrete outcomes. Biostatistics, 6(1): 11, 2005.
7. Y. Freund and D. Haussler. Unsupervised learning of distributions on binary vectors using two layer networks. Advances in Neural Information Processing Systems, pages 912-919, 1993.
8. P. V. Gehler, A.D. Holub, and M. Welling. The rate adapting Poisson model for information retrieval and object recognition. In Proceedings of the ICML, pages 337-344, 2006.
9. J. Geweke. Efficient simulation from the multivariate normal and student-t distributions subject to linear constraints and the evaluation of constraint probabilities. In Computing science and statistics: Proceedings of the 23rd symposium on the interface, pages 571-578, 1991.
10. G.E. Hinton and R.R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313 (5786):504-507, 2006. (Pubitemid 44148451)
11. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems (TOIS), 20(4):446, 2002.
12. E. Khan, B. Marlin, and K. Murphy. Variational bounds for mixed-data factor analysis. In Proc. of Neural Information Processing Systems, 2010.
13. A. Kottas, P. Müller, and F. Quintana. Nonparametric Bayesian modeling for multivariate ordinal data. Journal of Computational and Graphical Statistics, 14(3):610-625, 2005. (Pubitemid 41442152)
14. N. Le Roux, N. Heess, J. Shotton, and J. Winn. Learning a generative model of images by factoring appearance and shape. Neural Computation, 23(3):593-650, 2011.
15. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A.Y. Ng. Multimodal deep learning. In ICML, 2011.
16. M.A. Ranzato and G.E. Hinton. Modeling pixel means and covariances using factorized third-order Boltzmann machines. In CVPR, pages 2551-2558. IEEE, 2010.
17. C.P. Robert. Simulation of truncated normal variables. Statistics and computing, 5(2):121-125, 1995.
18. R. Salakhutdinov and G. Hinton. Deep Boltzmann Machines. In Proceedings of 20th AISTATS, volume 5, pages 448-455, 2009a.
19. R. Salakhutdinov and G. Hinton. Replicated softmax: an undirected topic model. Advances in Neural Information Processing Systems, 22, 2009b.
20. R. Salakhutdinov, A. Mnih, and G. Hinton. Restricted Boltzmann machines for collaborative filtering. In Proceedings of the 24th ICML, pages 791-798, 2007.
21. Y. Shi, M. Larson, and A. Hanjalic. List-wise learning to rank with matrix factorization for collaborative filtering. In ACM RecSys, pages 269-272. ACM, 2010.
22. P. Smolensky. Information processing in dynamical systems: Foundations of harmony theory. Parallel distributed processing: Explorations in the microstructure of cognition, 1:194-281, 1986.
23. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep Boltzmann machines. In NIPS, pages 2231-2239, 2012.
24. L. L. Thurstone. A law of comparative judgment. Psycho-logical review, 34(4):273, 1927.
25. T. Tieleman. Training restricted Boltzmann machines using approximations to the likelihood gradient. In Proceedings of the 25th ICML, pages 1064-1071, 2008.
26. M. E. Tipping and C.M. Bishop. Probabilistic principal component analysis. Journal of the Royal Statistical Society: Series B, 61(3):611-622, 1999.
27. T. Tran, D.Q. Phung, and S. Venkatesh. Mixed-variate restricted Boltzmann machines. In Proc. of 3rd Asian Conference on Machine Learning (ACML), Taoyuan, Taiwan, 2011.
28. T. Tran, D.Q. Phung, and S. Venkatesh. Cumulative restricted Boltzmann machines for ordinal matrix data analysis. In Proc. of 4th Asian Conference on Machine Learning (ACML), Singapore, 2012.
29. T. Truyen, D.Q Phung, and S. Venkatesh. Probabilistic models over ordered partitions with applications in document ranking and collaborative filtering. In Proc. of SIAM Conference on Data Mining (SDM), Mesa, Arizona, USA, 2011. SIAM.
30. T.T. Truyen, D.Q. Phung, and S. Venkatesh. Ordinal Boltzmann machines for collaborative filtering. In Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI), Montreal, Canada, June 2009.
31. L. van der Maaten and G. Hinton. Visualizing data using t-SNE. Journal of Machine Learning Research, 9(2579-2605):85, 2008.
32. M. Wedel and W.A. Kamakura. Factor analysis with (mixed) observed and latent variables in the exponential family. Psychometrika, 66(4):515-530, 2001. (Pubitemid 33570085)
33. E. Xing, R. Yan, and A.G. Hauptmann. Mining associated text and images with dual-wing harmoniums. In Proceedings of the 21st UAI, 2005.
34. M. Yasuda and K. Tanaka. Boltzmann machines with bounded continuous random variables. Interdisciplinary Information Sciences, 13(1):25-31, 2007.
35. L. Younes. Parametric inference for imperfectly observed Gibbsian fields. Probability Theory and Related Fields, 82 (4): 625-645, 1989.
36. X. Zhang, W.J. Boscardin, and T.R. Belin. Bayesian analysis of multivariate nominal measures using multivariate multinomial probit models. Computational statistics & data analysis, 52(7):3697-3708, 2008.