Separation of non-negative mixture of non-negative sources using a Bayesian approach and MCMC sampling

IEEE Transactions on Signal Processing

Volumn 54, Issue 11, 2006, Pages 4133-4145

  Moussaoui, Saïd ^a   Brie, David ^a   Mohammad Djafari, Ali ^b   Carteret, Cédric ^c  

^a CENTRE DE RECHERCHE EN AUTOMATIQUE DE NANCY   (France)

^b UNIV PARIS SUD   (France)

^c Laboratoire de Chimie Physique et Microbiologie pour l'Environnement   (France)

Author keywords

Bayesian estimation; Gamma distribution; Markov chain Monte Carlo (MCMC); Non negativity constraint; Source separation; Spectroscopy

Indexed keywords

BLIND SOURCE SEPARATION; MARKOV PROCESSES; MONTE CARLO METHODS; SAMPLING; SIGNAL ENCODING; SPECTROSCOPY;

BAYESIAN ESTIMATION; GAMMA DISTRIBUTION; MARKOV CHAIN MONTE CARLO (MCMC);

SIGNAL PROCESSING;

EID: 33750402597     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2006.880310     Document Type: Article

References (65)

1. E. R. Malinowski, Factor Analysis in Chemistry, 3rd ed. New York: Wiley, 2002.
2. P. J. Gemperline and E. Cash, "Advantages of soft versus hard constraints in self-modeling curve resolution problems. Alternating least squares with penalty function," Anal. Chem., vol. 75, pp. 4236-4243, 2003.
3. J. Shoonover, R. Max, and S. Zhang, "Multivariate curve resolution in the analysis of vibrational spectroscopy data files," Appl. Spectrosc., vol. 57, no. 5, pp. 154-170, 2003.
4. H. Pfeiffer and H. Liebhafsky, "The origins of Beer's law," J. Chem. Educ., vol. 28, p. 123, 1951.
5. R. Ricci, M. Ditzler, and L. Nestor, "Discovering the Beer-Lambert law," J. Chem. Educ., vol. 71, pp. 983-985, Nov. 1994.
6. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educ. Psychol., vol. 24, pp. 417-441, 1933.
7. P. Comon, "Independent component analysis - A new concept?," Signal Process., vol. 36, pp. 287-314, 1994.
8. T.-W. Lee, Independent Component Analysis - Theory and Applications. Norwell, MA: Kluwer, 1998.
9. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
10. A. Cichocki and S. Amari, Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications. New York: Wiley, 2002.
11. D. Nuzillard and J.-M. Nuzillard, "Application of blind source separation to 1-D and 2-D nuclear magnetic resonance spectroscopy," IEEE Signal Process. Lett., vol. 5, no. 8, pp. 209-211, 1998.
12. A. Belouchrani, K. A. Meraim, J.-F. Cardoso, and E. Moulines, "A blind source separation technique using second order statistics," IEEE Trans. Signal Process., vol. 45, no. 2, pp. 434-444, Feb. 1997.
13. M. D. Plumbley, "Algorithms for non-negative independent component analysis," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 534-543, 2003.
14. M. D. Plumbley and E. Oja, "A non-negative PCA algorithm for independent component analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 66-76, 2004.
15. M. D. Plumbley, "Conditions for non-negative independent component analysis," IEEE Signal Process. Lett., vol. 9, no. 6, pp. 177-180, 2002.
16. R. Tauler and B. Kowalski, "Multivariate curve resolution applied to spectral data from multiple runs of an industrial process," Anal. Chem., vol. 65, pp. 2040-2047, 1993.
17. C. L. Lawson and R. J. Hanson, Solving Least-Squares Problems. Englewood Cliffs, NJ: Prentice-Hall, 1974.
18. R. Bro and S. De Jong, "A fast non-negativity constrained least squares algorithm," J. Chemom., vol. 11, pp. 393-401, 1997.
19. W. H. Lawton and E. Sylvestre, "Self-modeling curve resolution," Technometrics, vol. 13, pp. 617-633, 1971.
20. W. Windig, "Mixture analysis of spectral data by multivariate methods," Chemom. Intell. Lab. Syst., vol. 9, pp. 7-30, 1990.
21. R. Tauler, A. Izquierdo-Ridorsa, and E. Casassas, "Simultaneous analysis of several spectroscopic titrations with self-modelling curve resolution," Chemom. Intell. Lab. Syst., vol. 18, no. 3, pp. 293-300, 1993.
22. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, pp. 788-791, 1999.
23. P. Sajda, S. Du, T. Brown, R. Stoyanova, D. Shungu, X. Mao, and L. Parra, "Nonnegative matrix factorization for rapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain," IEEE Trans. Med. Imag., vol. 23, no. 12, pp. 1453-1465, 2004.
24. P. O. Hoyer, "Non-negative sparse coding," in Proc. IEEE Workshop Neural Networks Signal Processing (NNSP), 2002, pp. 557-565.
25. P. Paatero and U. Tapper, "Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, pp. 111-126, 1994.
26. P. Paatero, "Least squares formulation of robust non-negative factor analysis," Chemom. Intell. Lab. Syst., vol. 37, pp. 23-35, 1997.
27. S. Roberts, "Independent component analysis: Source assessment and separation, a Bayesian approach,Proc. Inst. Elect. Eng. - Vision, Image, Signal Process., vol. 145, no. 3, pp. 149-154, 1998.
28. K. Knuth, "A Bayesian approach for source separation," in Proc. Int. Conf. Independent Component Analysis Blind Signal Separation (ICA), 1999, pp. 283-288.
29. A. Mohammad-Djafari, "A Bayesian approach to source separation," in Proc. Int. Workshop Bayesian Inference Maximum Entropy Methods Science Engineering (MaxEnt), 1999, pp. 36-46.
30. S. Sénécal and P.-O. Amblard, "Bayesian separation of discrete sources via Gibbs sampling," in Proc. Int. Conf. Independent Component Analysis Blind Signal Separation (ICA), 2000, pp. 566-572.
31. D. Rowe, Multivariate Bayesian Statistics: Models for Source Separation and Signal Unmixing. Boca Raton, FL: CRC, 2003.
32. M. Ichir and A. Mohammad-Djafari, "Wavelet domain blind image separation," in Proc. SPIE, Wavelets: Applications in Signal and Image Processing X, Nov. 2003, vol. 5207, pp. 361-370.
33. H. Snoussi and A. Mohammad-Djafari, "Fast joint separation and segmentation of mixed images," J. Electron. Imag., vol. 13, no. 2, pp. 349-361, 2004.
34. M. Ochs, R. Stoyanova, F. Arias-Mendoza, and T. Brown, "A new method for spectral decomposition using a bilinear Bayesian approach," J. Magn. Reson., vol. 137, pp. 161-176, 1999.
35. J. Miskin and D. MacKay, "Ensemble learning for blind source separation," in Independent Component Analysis: Principles and Practice, S. Roberts and R. Everson, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2001, pp. 209-233.
36. S. Roberts and R. Choudrey, "Data decomposition using independent component analysis with prior constraints," Pattern Recognit., vol. 36, pp. 1813-1825, 2003.
37. S. Moussaoui, A. Mohammad-Djafari, D. Brie, and O. Caspary, "A Bayesian method for positive source separation," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2004, pp. 485-489.
38. S. A. Abdallah and M. D. Plumbley, "Polyphonic transcription by non-negative sparse coding of power spectra," in Proc. Int. Conf. Music Information Retrieval (ISMIR), Barcelona, Spain, Oct. 2004, pp. 318-325.
39. W. Gilks, S. Richardson, and D. Spiegehalter, Markov Chain Monte Carlo in Practice. London, U.K.: Chapman & Hall, 1999.
40. C. Robert, Monte Carlo Statistical Methods. New York: Springer-Verlag, 1999.
41. M.-H. Chen, Q.-M. Shao, and J. G. Ibrahim, Monte Carlo Methods in Bayesian Computation. New York: Springer-Verlag, 2000.
42. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 6, pp. 721-741, 1984.
43. G. Casella and E. I. George, "Explaining the Gibbs sampler," Amer. Stat., vol. 46, pp. 167-174, 1992.
44. W. K. Hastings, "Monte Carlo sampling methods using Markov chains and their applications," Biometrika, vol. 57, no. 1, pp. 97-109, 1970.
45. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Taller, and E. Taller, "Equation of state calculation by fast computing machines," J. Chem. Phy., vol. 21, pp. 1087-1092, 1953.
46. C. Robert, The Bayesian Choice, 2nd ed. New York: Springer-Verlag, 2001.
47. A. Stuart and J. Ord, Kendall's Advanced Theory of Statistics, 6th ed. New York: Wiley, 1994, vol. 1, Distribution Theory.
48. I.-T. Hsiao, A. Rangarajan, and G. Gindi, "Bayesian image reconstruction using mixture models as priors," IEEE Trans. Image Process., vol. 11, no. 12, pp. 1466-1477, 2002.
49. A. E. Gelfand and A. F. M. Smith, "Sampling based approaches to calculating marginal densities," J. Amer. Stat. Assoc., vol. 85, pp. 399-409, 1990.
50. L. Tierney, "Markov chains for exploring posterior distributions," Ann. Stat., vol. 22, pp. 1701-1762, 1994.
51. A. E. Gelfand, "Gibbs sampling," J. Amer. Stat. Assoc., vol. 95, pp. 1300-1304, 2000.
52. M. Cowles and B. Carlin, "Markov chain Monte Carlo convergence diagnostics: A comparative review," J. Amer. Stat. Assoc., vol. 91, pp. 883-904, 1996.
53. L. Devroy, Non-Uniform Random Variate Generation. New York: Springer-Verlag, 1986.
54. A. E. Gelfand, A. Smith, and T. Lee, "Bayesian analysis of constrained parameter and truncated data problems using Gibbs sampling," J. Amer. Stat. Assoc., vol. 87, pp. 523-532, 1992.
55. C. Robert, "Simulation of a truncated normal variables," Stat. Comput., vol. 5, pp. 121-125, 1995.
56. H. Snoussi and A. Mohammad-Djafari, "Penalized maximum likelihood for multivariate Gaussian mixtures," in Proc. Int. Workshop Bayesian Inference Maximum Entropy Methods Science Engineering (MaxEnt), 2001, pp. 36-46.
57. M. Abrahamovitz and I. Stegun, Handbook of Mathematical Functions. New York: Dover, 1972.
58. W. Press, S. Teukolsky, W. Vetterling, and B. Flannery, Numerical Recipes in C, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1992.
59. S. Hosseini, C. Jutten, and D.-T. Pham, "Markovian source separation," IEEE Trans. Signal Process., vol. 51, no. 12, pp. 3009-3019, Dec. 2003.
60. A. Mansour, M. Kawamoto, and N. Ohnishi, "A survey of the performance indexes of ICA algorithms," in Proc. IASTED Int. Conf. Modeling, Identification, Control (MIC), 2002, pp. 660-666.
61. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," Proc. Inst. Elect. Eng. - F, vol. 140, no. 6, pp. 362-370, 1993.
62. A. Hyvärinen and E. Oja, "A fast fixed-point algorithm for independent component analysis," Neural Comput., vol. 9, no. 7, pp. 1483-1492, 1997.
63. D. Donoho and V. Stodden, "When does non-negative matrix factorization give a correct decomposition into parts?," presented at the Advances Neural Information Processing Systems (NIPS), Cambridge, MA, 2003.
64. S. Moussaoui, D. Brie, and J. Idier, "Non-negative source separation: Range of admissible solutions and conditions for the uniqueness of the solution," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2005, pp. 289-292.
65. J. van den Hof and J. van Schuppen, "Positive matrix factorization via extremal polyhedral cones," Linear Algebra Appl., vol. 293, pp. 171-186, 1999.