Informed source separation: A Bayesian tutorial

13th European Signal Processing Conference, EUSIPCO 2005

Volumn , Issue , 2005, Pages 1467-1474

  Knuth, Kevin H ^a  

^a NASA AMES RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM DESIGN; BAYESIAN APPROACHES; HIGH QUALITY; ORIGINAL SIGNAL; PHYSICAL SCIENCE; PROBLEM DESCRIPTION; SEPARATION PROBLEMS; SIGNAL MODELS; SPECIFIC PROBLEMS;

BAYESIAN NETWORKS;

SIGNAL PROCESSING;

EID: 84863700209     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. A. J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Comp., 7, 1129-1159, 1995.
2. K. H. Knuth, "A Bayesian approach to source separation," in J.-F. Cardoso, C. Jutten and P. Loubaton (eds.), Proc First Int Workshop on ICA and Signal Separation: ICA'99, Aussois, France, Jan. 1999, pp. 283-288, 1999.
3. K. H. Knuth, "Lattice duality: The origin of probability and entropy," In press: Neurocomputing, 2005.
4. K. H. Knuth "Difficulties applying recent blind source separation techniques to EEG and MEG," in G. J. Erickson, J. T. Rychert and C. R. Smith (eds.), Maximum Entropy and Bayesian Methods, Boise 1997, Dordrecht: Kluwer, pp. 209-222, 1998.
5. K. H. Knuth "Bayesian source separation and localization," in A. Mohammad-Djafari (ed.), SPIE'98 Proceedings: Bayesian Inference for Inverse Problems, San Diego, July 1998, pp. 147-158, 1998. Note that errors are corrected in the online version http://arxiv.org/abs/physics/0205069
6. K. H. Knuth and H. G. Vaughan, Jr., "The Bayesian origin of blind source separation and electromagnetic source estimation," in W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Maximum Entropy and Bayesian Methods, Munich 1998, Dordrecht:Kluwer, pp. 217-226, 1999.
7. E. T. Jaynes Probability theory: the logic of science. Cambridge:Cambridge Univ. Press, 2003.
8. G. L. Bretthorst, Bayesian Spectrum Analysis and Parameter Estimation, Lecture Notes in Statistics, vol. 48, New York:Springer-Verlag, 1988.
9. W. A. Truccolo, M. Ding, K. H. Knuth, R. Nakamura, and S. L. Bressler, "Trial-to-trial variability of cortical evoked responses: implications for the analysis of functional connectivity," Clin. Neurophysiol. 113(2), 206-226, 2002.
10. K. H. Knuth, W. A. Truccolo, S. L. Bressler and M. Ding "Separation of multiple evoked responses using differential amplitude and latency variability," in T.-W. Lee, T.-P. Jung, S. Makeig, T.J. Sejnowski (eds.), Proc Third Int Workshop on ICA and Blind Signal Separation: ICA 2001, Dec 2001, San Diego, USA, pp. 463-468, 2001.
11. Truccolo, W.A., Knuth, K.H., Shah, A.S., Bressler, S.L., Schroeder, C.E., and Ding, M., "Estimation of single-trial multi-component ERPs: Differentially variable component analysis (dVCA)," Biol Cybern. 89, 426-438, 2003
12. K. H. Knuth, A. S. Shah,W. A. Truccolo, M. Ding, S. L. Bressler, C. E. Schroeder, "Differentially variable component analysis (dVCA): Identifying multiple evoked components using trial-to-trial variability", submitted.
13. C. Jutten, J. Herault, "Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture", Signal Process, 24, 1-10, 1991.
14. D. T. Pham, P. Garrat, C. Jutten, "Separation of a mixture of independent sources through a maximum likelihood approach", Proc. EUSIPCO, p.771-774, 1992.
15. A. Cichocki, R. Unbehauen, E. Rummert, "Robust learning algorithm for blind separation of signals", Electron Lett, 30, 1386-1387, 1994.
16. J.-F. Cardoso, "Infomax and maximum likelihood for source separation", IEEE Signal Proc Let, 4, 112-114, 1997.
17. D. J. C. MacKay, "Maximum likelihood and covariant algorithms for independent component analysis", Draft Paper, 1996, available at: http://wol.ra.phy.cam.ac.uk/mackay/
18. B. A. Pearlmutter, L. C. Parra. Maximum likelihood blind source separation: A context-sensitive generalization of ICA. In Advances in Neural Information Processing Systems 9. MIT Press:Cambridge, 613-619, 1997.
19. S. J. Roberts, "Independent component analysis: Source assessment & separation, a Bayesian approach." IEE Proc: Vision, Image & Sig Proc, 145(3), 149-154, 1998.
20. A. Mohammad-Djafari, "A Bayesian Approach to Source Separation" In: G.J. Erickson, J.T. Rychert and C.R. Smith (eds.), Maximum Entropy and Bayesian Methods, Boise 1999, AIP Conf Proc 567, Melville NY:AIP, 221-244, 2001.
21. D. B. Rowe, "A Bayesian Approach to Blind Source Separation". Journal of Interdisciplinary Mathematics, 5(1), 49-76, 2002.
22. S.-I. Amari, "Natural gradient works efficiently in learning," Neural Comp, 10, 251-276, 1998.
23. A. Hyvärinen, E. Oja, "A fast fixed-point algorithm for independent component analysis", Neural Computation, 9, 1483-1492, 1997.
24. S. Sénécal and P.-O. Amblard, "MCMC methods for discrete source separation," In: A. Mohammad-Djafari (ed.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering, Paris 2000, AIP Conf Proc 568, Melville NY:AIP, pp. 350-360, 2001.
25. C. Févotte, S. J. Godsill. "A Bayesian approach for blind separation of sparse sources", in press: IEEE T Speech Audi P.
26. R. M. Everson, S. J. Roberts, "Particle Filters for Non-stationary ICA," in M. Girolami (ed.), Advances in Independent Components Analysis, Springer Verlag, pages 23-41, 2000.
27. J.-R. Larocque, J. P. Reilly, W. Ng, "Particle filters for tracking an unknown number of sources," IEEE T Signal Proces, 50, 2926-2937, 2002.
28. H. Lappalainen, "Ensemble Learning for Independent Component Analysis" in J.-F. Cardoso, C. Jutten and P. Loubaton (eds.), Proc First Int. Workshop on ICA and Signal Separation: ICA'99, Aussois, France, Jan. 1999, pp. 7-12.
29. J. Miskin, D. J. C. MacKay, "Ensemble learning for blind image separation and deconvolution," In: M. Girolami (ed.), Advances in Independent Component Analysis, Springer-Verlag, pp. 123-141, 2000.
30. P. A. d. F. R. Hojen-Sorensen, L. K. Hansen, O. Winther, "Mean Field Implementation of Bayesian ICA," in T.-W. Lee, T.-P. Jung, S. Makeig, T.J. Sejnowski (eds.), Proc Third Int Workshop on ICA and Blind Signal Separation: ICA 2001, Dec 2001, San Diego, USA, pp. 439-444, 2001.
31. H. Valpola and J. Karhunen. An unsupervised ensemble learning method for nonlinear dynamic state-space models. Neural Comp, 14, 2647-2692, 2002.
32. N. D. Lawrence, C. M. Bishop, "Variational Bayesian independent component analysis" Univ of Cambridge Tech Report, 2000.
33. R. A. Choudrey, S. J. Roberts, "Flexible Bayesian Independent Component Analysis for Blind Source Separation" in T.-W. Lee, T.-P. Jung, S. Makeig, T.J. Sejnowski (eds.), Proc Third Int Workshop on ICA and Blind Signal Separation: ICA 2001, Dec 2001, San Diego, USA, pp. 90-95, 2001.
34. D. S. Sivia, Data Analysis. A Bayesian Tutorial, Oxford: Clarendon Press, 1996.
35. J. Skilling, "Probabilistic data analysis: an introductory guide," J. Microscopy 190, 28-36, 1998.
36. V. Dose, "Bayes in five days," Reprint no. 83, Centre for Interdisciplinary Plasma Science, 2002.