Hierarchical models of variance sources

Signal Processing

Volumn 84, Issue 2, 2004, Pages 267-282

  Valpola, Harri ^a   Harva, Markus ^a   Karhunen, Juha ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Blind source separation; Factor analysis; Hierarchical model; Variance modelling; Variational Bayesian learning

Indexed keywords

BLIND SOURCE SEPARATION; CONVERGENCE OF NUMERICAL METHODS; DATA REDUCTION; HIERARCHICAL SYSTEMS; INDEPENDENT COMPONENT ANALYSIS; ITERATIVE METHODS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; PARAMETER ESTIMATION; PROBABILITY DENSITY FUNCTION; SYSTEM STABILITY; VARIATIONAL TECHNIQUES; VECTORS;

BAYESIAN ANALYSIS; FACTOR ANALYSIS; GAUSSIAN DISTRIBUTIONS;

SIGNAL THEORY;

EID: 0346724352     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2003.10.014     Document Type: Conference Paper

References (28)

1. Attias H. Independent factor analysis. Neural Comput. 11(4):1999;803-851.
2. Barber D., Bishop C. Ensemble learning in Bayesian neural networks. Bishop C. Neural Networks and Machine Learning. 1998;215-237 Springer, Berlin.
3. Bollerslev T. Generalized autoregressive conditional heteroskedasticity. J. Econometrics. 31:1986;307-327.
4. J.-F. Cardoso, Multidimensional independent component analysis, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'98), Seattle, Washington, USA, May 12-15, 1998, pp. 1941-1944.
5. K. Chan, T.-W. Lee, T. Sejnowski, Variational learning of clusters of undercomplete nonsymmetric independent components, in: Proceedings of the International Conference on Independent Component Analysis and Signal Separation (ICA2001), San Diego, USA, 2001, pp. 492-497.
6. R. Choudrey, W. Penny, S. Roberts, An ensemble learning approach to independent component analysis, in: Proceedings of the IEEE Workshop on Neural Networks for Signal Processing, Sydney, Australia, December 2000. IEEE Press, pp. 435-444.
7. L. De Lathauwer, B. De Moor, J. Vandewalle, Fetal electrocardiogram extraction by source subspace separation, in: Proceedings of the IEEE Signal Processing/ATHOS Workshop on Higher-order Statistics, 1995, pp. 134-138.
8. FastICA, The FastICA MATLAB package, 1998. Available at http://www.cis.hut.fi/projects/ica/fastica/.
9. Ghahramani Z., Hinton G.E. Variational learning for switching state-space models. Neural Comput. 12(4):2000;963-996.
10. Ghysels E., Harvey A.C., Renault E. Stochastic volatility. Rao C.R., Maddala G.S. Statistical Methods in Finance. 1996;119-191 North-Holland, Amsterdam.
11. Girolami M. Variational method for learning sparse and overcomplete representations. Neural Comput. 13(11):2001;2517-2532.
12. G.E. Hinton, D. van Camp, Keeping neural networks simple by minimizing the description length of the weights, in: Proceedings of the Sixth Annual ACM Conference on Computational Learning Theory, Santa Cruz, CA, USA, 1993, pp. 5-13.
13. Honkela A., Valpola H., Karhunen J. Accelerating cyclic update algorithms for parameter estimation by pattern searches. Neural Process. Lett. 17(2):2003;191-203.
14. Hyvärinen A., Hoyer P. Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Comput. 12(7):2000;1705-1720.
15. A. Hyvärinen, J. Hurri, Blind separation of sources that have spatiotemporal dependencies, Signal Processing, (2003) submitted for publication.
16. Hyvärinen A., Karhunen J., Oja E. Independent Component Analysis. 2001;Wiley, New York.
17. A. Ilin, H. Valpola, On the effect of the form of the posterior approximation in variational learning of ICA models, in: Proceedings of the Fourth International Symposium on Independent Component Analysis and Blind Signal Separation (ICA2003), Nara, Japan, 2003, pp. 915-920.
18. M. Jordan (Ed.), Learning in Graphical Models, The MIT Press, Cambridge, MA, USA, 1999.
19. Kim S., Shepard N., Chib S. Stochastic volatility. likelihood inference and comparison with ARCH models Rev. Econ. Stud. 65(3):July 1998;361-393.
20. Kohonen T., Kaski S., Lappalainen H. Self-organized formation of various invariant-feature filters in the adaptive-subspace SOM. Neural Comput. 9(6):1997;1321-1344.
21. Lappalainen H., Miskin J. Ensemble learning. Girolami M. Advances in Independent Component Analysis. 2000;75-92 Springer, Berlin.
22. Miskin J., MacKay D.J.C. Ensemble learning for blind image separation and deconvolution. Girolami M. Advances in Independent Component Analysis. 2000;123-141 Springer, Berlin.
23. L. Parra, C. Spence, P. Sajda, Higher-order statistical properties arising from the non-stationarity of natural signals, in: T. Leen, T. Dietterich, V. Tresp (Eds.), Advances in Neural Information Processing Systems, Vol. 13, The MIT Press, Cambridge, MA, USA, 2001, pp. 786-792.
24. H. Valpola, M. Harva, J. Karhunen, Hierarchical models of variance sources, in: Proceedings of the Fourth International Symposium on Independent Component Analysis and Blind Signal Separation (ICA2003), Nara, Japan, 2003a, pp. 83-88.
25. Valpola H., Karhunen J. An unsupervised ensemble learning method for nonlinear dynamic state-space models. Neural Comput. 14(11):2002;2647-2692.
26. H. Valpola, T. Östman, J. Karhunen, Nonlinear independent factor analysis by hierarchical models, in: Proceedings of the Fourth International Symposium on Independent Component Analysis and Blind Signal Separation (ICA2003), Nara, Japan, 2003b, pp. 257-262.
27. H. Valpola, T. Raiko, J. Karhunen, Building blocks for hierarchical latent variable models, in: Proceedings of the Third International Conference on Independent Component Analysis and Signal Separation (ICA2001), San Diego, USA, 2001, pp. 710-715.
28. Vigário R., Särelä J., Jousmäki V., Hämäläinen M., Oja E. Independent component approach to the analysis of EEG and MEG recordings. IEEE Trans. Biomed. Eng. 47(5):2000;589-593.