Nonlinear blind source separation by variational Bayesian learning

IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

Volumn E86-A, Issue 3, 2003, Pages 532-541

  Valpola, Harri ^a   Oja, Erkki ^a   Ilin, Alexander ^a   Honkela, Antti ^a   Karhunen, Juha ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Bayesian learning; Blind separation; Independent component analysis; Nonlinear dynamics

Indexed keywords

CHAOS THEORY; COMPUTATIONAL COMPLEXITY; DATA COMPRESSION; INDEPENDENT COMPONENT ANALYSIS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MULTILAYER NEURAL NETWORKS; NONLINEAR EQUATIONS; SIGNAL FILTERING AND PREDICTION; SPEECH PROCESSING; SPURIOUS SIGNAL NOISE; VARIATIONAL TECHNIQUES;

NONLINEAR BLIND SOURCE SEPARATION; VARIATIONAL BAYESIAN TECHNIQUE;

BLIND SOURCE SEPARATION;

EID: 0038036528     PISSN: 09168508     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. H. Attias, "ICA, graphical models and variational methods," in Independent Component Analysis: Principles and Practice, ed. S. Roberts and R. Everson, pp.95-112, Cambridge University Press, 2001.
2. T. Briegel and V. Tresp, "Fisher scoring and a mixture of modes approach for approximate inference and learning in nonlinear state space models," in Advances in Neural Information Processing Systems 11, ed. M. Kearns. S. Solla, and D. Cohn, pp.403-409, The MIT Press, Cambridge, MA, USA, 1999.
3. M. Casdagli, "Nonlinear prediction of chaotic time series," Physica D, vol.35, pp.335-356, 1989.
4. R.A. Choudrey and S.J. Roberts, "Flexible Bayesian independent component analysis for blind source separation," Proc. Int. Conf. on Independent Component Analysis and Signal Separation (ICA2001), pp.90-95, San Diego, USA, 2001.
5. Z. Ghahramani and S. Roweis, "Learning nonlinear dynamical systems using an EM algorithm," in Advances in Neural Information Processing Systems 11, ed. M. Kearns, S. Solla, and D. Cohn, pp.431-437, The MIT Press, Cambridge, MA, USA, 1999.
6. M. Girolami, "Variational method for learning sparse and overcomplete representations," Neural Computation, vol.13, no.11, pp.2517-2532, 2001.
7. F. Gustafsson, Adaptive Filtering and Change Detection, John Wiley and Sons, 2000.
8. S. Haykin, Neural Networks - A Comprehensive Foundation, 2nd ed., Prentice-Hall, 1999.
9. S. Haykin and J. Principe, "Making sense of a complex world," IEEE Signal Process. Mag., vol.15, no.3, pp.66-81, May 1998.
10. G. Hinton and D. van Camp, "Keeping neural networks simple by minimizing the description length of the weights," Proc. 6th Ann. ACM Conf. on Computational Learning Theory, pp.5-13, Santa Cruz, CA, USA, 1993.
11. P. Højen-Sørensen, L.K. Hansen, and O. Winther, "Mean field implementation of Bayesian ICA," Proc. Int. Conf. on Independent Component Analysis and Signal Separation (ICA2001), pp.439-444, San Diego, USA, 2001.
12. A. Hyvärinen, J. Karhunen and E. Oja, Independent Component Analysis, J. Wiley, 2001.
13. A. Hyvärinen and P. Pajunen, "Nonlinear independent component analysis: Existence and uniqueness results," Neural Networks, vol. 12, no. 3, pp.429-439, 1999.
14. A. Iline, H. Valpola, and E. Oja, "Detecting process state changes by nonlinear blind source separation," Proc. Int. Conf. on Independent Component Analysis and Signal Separation (ICA2001), pp.704-709, San Diego, USA, 2001.
15. H. Lappalainen and A. Honkela, "Bayesian nonlinear independent component analysis by multi-layer perceptrons," in Advances in Independent Component Analysis, ed. M. Girolami, pp.93-121, Springer-Verlag, Berlin, 2000.
16. H. Lappalainen and J. Miskin, "Ensemble learning," in Advances in Independent Component Analysis, ed. M. Girolami, pp.75-92, Springer, Berlin, 2000.
17. J. Miskin and D. MacKay, "Ensemble learning for blind source separation," in Independent Component Analysis Principles and Practice, ed. S. Roberts and R. Everson, pp.209-233, Cambridge University Press, 2001.
18. 2-control charts to maintain current control of a process," Management Science, vol.19, no.1, pp.76-89, 1972.
19. A. Taleb, "A generic framework for blind source separation in structured nonlinear models," IEEE Trans. Signal Process., vol.50, no.8, pp.1819-1830, 2002.
20. A. Taleb and C. Jutten, "Source separation in post-nonlinear mixtures," IEEE Trans. Signal Process., vol.47, no.10, pp.2807-2820, 1999.
21. H. Valpola, Bayesian Ensemble Learning for Nonlinear Factor Analysis, PhD Thesis, Helsinki University of Technology, Espoo, Finland, 2000. Published in Acta Polytechnica Scandinavica, Mathematics and Computing Series, no.108.
22. H. Valpola, A. Honkela, and X. Giannakopoulos, Matlab codes for the NFA and NDFA algorithms. http://www.cis.hut.fi/projects/ica/bayes/, 2002.
23. H. Valpola and J. Karhunen, "An unsupervised ensemble learning method for nonlinear dynamic state-space models," Neural Computation, vol.14, no.11, pp.2647-2692, 2002.