Natural conjugate gradient in variational inference

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4985 LNCS, Issue PART 2, 2008, Pages 305-314

  Honkela, Antti ^a   Tornio, Matti ^a   Raiko, Tapani ^a   Karhunen, Juha ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

CONJUGATE GRADIENT METHOD; GRADIENT METHODS; LEARNING SYSTEMS; MAXIMUM LIKELIHOOD ESTIMATION; PROBABILITY DISTRIBUTIONS; SPEED;

APPROXIMATE INFERENCES; COMPUTATIONAL OVERHEADS; CONJUGATE GRADIENTS; EXPONENTIAL FAMILIES; MACHINE LEARNINGS; MAXIMUM-LIKELIHOOD; NATURAL GRADIENT METHODS; OBJECTIVE FUNCTIONS; PREDICTIVE DISTRIBUTIONS; RIEMANNIAN STRUCTURES; SPEECH DATUM; SPEED-UP; SPEED-UPS; VARIATIONAL BAYES; VARIATIONAL BAYESIAN; VARIATIONAL INFERENCES; VARIATIONAL METHODS;

LEARNING ALGORITHMS;

EID: 54049158947     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-69162-4_32     Document Type: Conference Paper

References (15)

1. Bishop, C.: Pattern Recognition and Machince Learning. Springer, Heidelberg (2006)
2. Barber, D., Bishop, C.: Ensemble learning for multi-layer networks. In: Advances in Neural Information Processing Systems 10, pp. 395-401. The MIT Press, Cambridge (1998)
3. Seeger, M.: Bayesian model selection for support vector machines, Gaussian processes and other kernel classifiers. In: Advances in Neural Information Processing Systems 12, pp. 603-609. MIT Press, Cambridge (2000)
4. Lappalainen, H., Honkela, A.: Bayesian nonlinear independent component analysis by multi-layer perceptrons. In: Girolami, M. (ed.) Advances in Independent Component Analysis, pp. 93-121. Springer, Berlin (2000)
5. Valpola, H., Karhunen, J.: An unsupervised ensemble learning method for nonlinear dynamic state-space models. Neural Computation 14(11), 2647-2692 (2002)
6. Valpola, H., Harva, M., Karhunen, J.: Hierarchical models of variance sources. Signal Processing 84(2), 267-282 (2004)
7. Honkela, A., Valpola, H.: Unsupervised variational Bayesian learning of nonlinear models. In: Advances in Neural Information Processing Systems 17, pp. 593-600. MIT Press, Cambridge (2005)
8. Amari, S.: Differential-Geometrical Methods in Statistics. Lecture Notes in Statistics, vol. 28. Springer, Heidelberg (1985)
9. Amari, S.: Natural gradient works efficiently in learning. Neural Computation 10(2), 251-276 (1998)
10. Sato, M.: Online model selection based on the variational Bayes. Neural Computation 13(7), 1649-1681 (2001)
11. Murray, M.K., Rice, J.W.: Differential Geometry and Statistics. Chapman and Hall, Boca Raton (1993)
12. Valpola, H.: Bayesian Ensemble Learning for Nonlinear Factor Analysis. PhD thesis, Helsinki University of Technology, Espoo, Finland, Published in Acta Polytechnica Scandinavica, Mathematics and Computing Series No. 108 (2000)
13. Nocedal, J.: Theory of algorithms for unconstrained optimization. Acta Numerica 1, 199-242 (1991)
14. Smith, S.T.: Geometric Optimization Methods for Adaptive Filtering. PhD thesis, Harvard University, Cambridge, Massachusetts (1993)
15. Edelman, A., Arias, T.A., Smith, S.T.: The geometry of algorithms with orthogonality constraints. SIAM Journal on Matrix Analysis and Applications 20(2), 303-353 (1998)