Gaussian processes for underdetermined source separation

IEEE Transactions on Signal Processing

Volumn 59, Issue 7, 2011, Pages 3155-3167

  Liutkus, Antoine ^a   Badeau, Roland ^a   Richard, Gäel ^a  

^a INSTITUT TELECOM   (France)

Author keywords

Cokriging; Gaussian processes (GP); kriging; nonnegative matrix factorization (NMF); nonnegative tensor factorizations (NTF); probability theory; regression; source separation

Indexed keywords

CO-KRIGING; GAUSSIAN PROCESS; KRIGING; NONNEGATIVE MATRIX FACTORIZATION; NONNEGATIVE TENSOR FACTORIZATIONS; PROBABILITY THEORY; REGRESSION; SOURCE SEPARATION;

COVARIANCE MATRIX; FACTORIZATION; GAUSSIAN NOISE (ELECTRONIC); LEARNING ALGORITHMS; MEAN SQUARE ERROR; RANDOM VARIABLES; REGRESSION ANALYSIS; TENSORS;

GAUSSIAN DISTRIBUTION;

EID: 79959219150     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2011.2119315     Document Type: Article

References (44)

1. P. Abrahamsen, "A review of Gaussian random fields and correlation functions," Norsk Regnesentral, Oslo, Norway, Tech. Rep. 878, Apr. 1997.
2. M. Alvarez and N. D. Lawrence, "Sparse convolved Gaussian processes for multi-output regression," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2008, pp. 57-64.
3. E. V. Bonilla, K. M. A. Chai, and C. K. I. Williams, "Multi-task Gaussian process prediction," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2007, pp. 153-160.
4. P. Boyle and M. Frean, "Multiple output Gaussian process regression," Victoria Univ. Wellington, Apr. 2005.
5. P. Boyle and M. R. Frean, "Dependent Gaussian processes," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2004, pp. 217-224.
6. J.-F. Cardoso, "Blind signal separation: Statistical principles," Proc. IEEE, vol. 90, pp. 2009-2026, Oct. 1998.
7. A. T. Cemgil, S. J. Godsill, P. H. Peeling, and N. Whiteley, "Bayesian statistical methods for audio and music processing," in The Oxford Handbook of Applied Bayesian Analysis. Oxford, U.K.: Oxford Univ. Press, 2010, 13: 978-0-19-954890-3.
8. A. T. Cemgil, P. Peeling, O. Dikmen, and S. Godsill, "Prior structures for time-frequency energy distributions," in Proc. 2007 IEEE Workshop Appl. Signal Process. Audio Acoust. (WASPAA), New York, Oct. 2007, pp. 151-154.
9. A. Cichocki, R. Zdunek, A. H. Phan, and S. Amari, Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation. New York: Wiley, Sep. 2009.
10. Handbook of Blind Source Separation: Independent Component Analysis and Blind Deconvolution, P. Comon and C. Jutten, Eds. New York: Academic, 2010.
11. P. J. Diggle and P. J. Ribeiro, Model-Based Geostatistics, ser. Springer Series in Statistics, 1st ed. New York: Springer, Mar. 2007.
12. O. Dikmen and A. T. Cemgil, "Gamma Markov random fields for audio source modelling," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 589-601, Mar. 2010.
13. O. Dikmen and A. T. Cemgil, "Unsupervised single-channel source separation using Bayesian NMF," in Proc. 2009 IEEE Workshop Appl. Signal Process. Audio Acoust. (WASPAA), New York, Oct. 2009, pp. 93-96.
14. J.-L. Durrieu, A. Ozerov, C. Févotte, G. Richard, and B. David, "Main instrument separation from stereophonic audio signals using a source/filter model," in Proc. 17th Eur. Signal Process. Conf. (EUSIPCO), Glasgow, U.K., Aug. 2009, pp. 15-19.
15. C. Duxbury, J. P. Bello, M. Davies, and M. Sandler, "Complex domain onset detection for musical signals," in Proc. Digit. Audio Effects Workshop (DAFx, London, U.K., Sep. 2003.
16. C. Févotte, N. Bertin, and J.-L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence. With application to music analysis," Neural Comput., vol. 21, no. 3, pp. 793-830, Mar. 2009.
17. D. FitzGerald, M. Cranitch, and E. Coyle, "On the use of the beta divergence for musical source separation," in Proc. Irish Signal Syst. Conf. (ISSC), 2008.
18. O. Gillet and G. Richard, "Transcription and separation of drum signals from polyphonic music," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 3, pp. 529-540, 2008.
19. A. Girard, C. E. Rasmussen, J. Quiñonero Candela, and R. Murray-Smith, "Gaussian process priors with uncertain inputs - Application to multiple-step ahead time series forecasting," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2002, pp. 529-536.
20. P. W. Goldberg, C. K. I. Williams, and C. M. Bishop, "Regression with input-dependent noise: A Gaussian process treatment," in Neural Information Processing Systems (NIPS), M. I. Jordan, M. J. Kearns, and S. A. Solla, Eds. Cambridge, MA: The MIT Press, 1997, pp. 493-499.
21. M. Helén and T. Virtanen, "Separation of drums from polyphonic music using non-negative matrix factorization and support vector machine," in Proc. 13th Eur. Signal Process. Conf. (EUSIPCO), Antalaya, Turkey, 2005.
22. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol. 14, no. 8, pp. 1771-1800, Aug. 2002.
23. E. T. Jaynes and G. L. Bretthorst, Probability Theory: The Logic of Science. Cambridge, U.K.: Cambridge Univ. Press, 2003.
24. A. G. Journel and C. J. Huijbregts, Mining Geostatistics. London, U.K.: Academic, 1978.
25. L. De Lathauwer, "Decompositions of a higher-order tensor in block terms - Part II: Definitions and uniqueness," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1033-1066, Sep. 2008.
26. J. Le Roux, E. Vincent, Y. Mizuno, H. Kameoka, N. Ono, and S. Sagayama, "Consistent Wiener filtering: Generalized time-frequency masking respecting spectrogram consistency," in Proc. 9th Int. Conf. Latent Variable Anal. Signal Separation (LVA/ICA 2010), St. Malo, France, Sep. 2010, pp. 89-96.
27. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Advances in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, Apr. 2001, vol. 13, pp. 556-562.
28. D. MacKay, "Gaussian processes - A replacement for supervised neural networks?," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 1997.
29. G. Matheron, "The intrinsic random functions and their applications," Adv. Appl. Probabil., vol. 5, no. 3, pp. 439-468, 1973.
30. A. Melkumyan and F. Ramos, "Multi-kernel Gaussian processes," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2009.
31. A. Melkumyan and F. Ramos, "A sparse covariance function for exact Gaussian process inference in large datasets," in Proc. 21st Int. Joint Conf. Artif. Intell. (IJCAI), San Francisco, CA, Jul. 2009, pp. 1936-1942.
32. A. Ozerov and C. Févotte, "Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 550-563, March 2010.
33. S. Park and S. Choi, "Gaussian processes for source separation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Las Vegas, NV, Mar. 2008, vol. 18, pp. 1909-1912.
34. J. Quiñonero-Candela, C. E. Rasmussen, and R. Herbrich, "A unifying view of sparse approximate Gaussian process regression," J. Mach. Learn. Res., vol. 6, pp. 1939-1959, Dec. 2005. (Pubitemid 41798128)
35. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). Cambridge, MA: The MIT Press, 2005.
36. M. Seeger, "Gaussian processes for machine learning," Int. J. Neural Syst., vol. 14, no. 2, pp. 69-106, Apr. 2004.
37. E. Snelson, "Local and global sparse Gaussian process approximations," in Proc. Artif. Intell. Statist. (AISTATS), San Juan, Puerto Rico, Mar. 2007, vol. 2, pp. 524-531.
38. E. Snelson and Z. Ghahramani, "Sparse Gaussian processes using pseudo-inputs," in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2006, pp. 1257-1264.
39. J. I. Tomita and Y. Hirai, "Acoustic echo cancellation using Gaussian processes," in Proc. 15th Int. Conf. Neural Inf. Process. (ICONIP), 2008, vol. 5507, Lecture Notes in Comput. Sci., pp. 353-360.
40. J. Vanhatalo and A. Vehtari, "Modelling local and global phenomena with sparse Gaussian processes," in Proc. 24th Conf. Uncertainty Artif. Intell. (UAI), Helsinki, Finland, Jul. 2008, pp. 571-578.
41. E. Vincent, N. Bertin, and R. Badeau, "Adaptive harmonic spectral decomposition for multiple pitch estimation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 528-537, Mar. 2010.
42. E. Vincent, C. Févotte, and R. Gribonval, "Performance measurement in blind audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1462-1469, 2006. (Pubitemid 46547636)
43. N. Wiener, Extrapolation, Interpolation, and Smoothing of Stationary Time Series With Engineering Applications. Cambridge, MA: MIT Press, 1949.
44. C. K. I. Williams, "Prediction with Gaussian processes: From linear regression to linear prediction and beyond," in Learning and Inference in Graphical Models, M. I. Jordan, Ed. New York: Kluwer, 1999.