Gamma markov random fields for audio source modeling

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 3, 2010, Pages 589-601

  Dikmen, Onur ^a   Cemgil, A Taylan ^a  

^a BOGAZICI UNIVERSITY   (Turkey)

Author keywords

Audio modeling; Contrastive divergence; Denoising; Gibbs sampling; Markov random fields; Pseudolikelihood; Score matching; Single channel source separation

Indexed keywords

CONTRASTIVE DIVERGENCE; DE-NOISING; GIBBS SAMPLING; MARKOV RANDOM FIELDS; PSEUDO-LIKELIHOOD; SINGLE-CHANNEL;

BLIND SOURCE SEPARATION; CHANNEL CAPACITY; GAUSSIAN NOISE (ELECTRONIC); IMAGE SEGMENTATION; MODELS; OPTIMIZATION; SEPARATION; SIGNAL ANALYSIS;

AUDIO SIGNAL PROCESSING;

EID: 76949090048     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2031778     Document Type: Article

References (37)

1. R. Martin, "Speech enhancement based on minimum mean square error estimation and supergaussian priors," IEEE Trans. Speech Audio Process., vol.13, no.5, pp. 845-856, Sep. 2005.
2. M. Grouse, R. Nowak, and R. Baraniuk, "Wavelet-based statistical signal processing using hidden Markov models," IEEE Trans. Signal Process., vol.46, no.4, pp. 886-902, Apr. 1998.
3. C. Févotte and S. Godsill, "A Bayesian approach for blind separation of sparse sources," IEEE Trans. Audio, Speech, Lang. Process., no.6, pp. 2174-2188, Nov. 2006.
4. S. J. Godsill, A. T. Cemgil, C. Févotte, and P. J.Wolfe, "Bayesian computational methods for sparse audio and music processing," in Proc. 15th Eur. Signal Process. Conf. (EURASIP), 2007.
5. B. A. Olshausen and K. J. Millman, "Learning sparse codes with a mixture-of-Gaussians prior," in Adv. Neural Inf. Process. Syst., 2000, pp. 841-847.
6. M. E. Davies and N. Mitianoudis, "A simple mixture model for sparse overcomplete ICA," IEE Proc. Vision, Image Signal Process., vol.151, no.1, pp. 35-43, 2004.
7. M. S. Lewicki and T. J. Sejnowski, "Learning overcomplete representations," Neural Comput., vol.12, no.2, pp. 337-365, 2000.
8. M. Girolami, "A variational method for learning sparse and over-complete representations," Neural Comput., vol.13, no.11, pp. 2517-2532, 2001.
9. P. Kidmose, "Alpha-stable distributions in signal processing of audio signals," in 41st Conf. Simulation Modelling, Scandinavian Simulation Soc., 2000, pp. 87-94, SIMS2000.
10. A. T. Cemgil, C. Févotte, and S. J. Godsill, "Variational and stochastic inference for Bayesian source separation," Digital Signal Process., 2007, vol. in Print.
11. J. A. Palmer, K. Kreutz-Delgado, D. P. Wipf, and B. D. Rao, "Variational EM algorithms for non-Gaussian latent variable models," in NIPS 2005, 2005.
12. J. A. Palmer, "Variational and scale mixture representations of non-Gaussian densities for estimation in the Bayesian linear model: Sparse coding, independent component analysis, and minimum entropy segmentation," Ph.D. dissertation, Univ. of California, San Diego, 2006.
13. J. A. Palmer, K. Kreutz-Delgado, B. D. Rao, and S. Makeig, "Modeling and estimation of dependent subspaces with non-radially symmetric and skewed densities," in Proc. 7th Int. Symp, Ind. Compon. Anal., 2007.
14. P. J. Wolfe, S. J. Godsill, and W. J. Ng, "Bayesian variable selection and regularisation for time-frequency surface estimation," J. R. Statist. Soc., Series B, vol.66, no.3, pp. 575-589, 2004.
15. P. J. Wolfe and S. J. Godsill, "Interpolation of missing data values for audio signal restoration using a Gabor regression model," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2005, pp. 517-520.
16. M. Reyes-Gomez, N. Jojic, and D. Ellis, "Deformable spectrograms," in Proc. AI Statist. Conf., , Barbados, 2005.
17. A. T. Cemgil and O. Dikmen, "Conjugate Gamma Markov random fields for modelling nonstationary sources," in ICA 2007, 7th Int. Conf. Ind. Compon. Anal. Signal Separation, 2007, pp. 697-705.
18. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol.PAMI-6, no.6, pp. 721-741, Nov. 1984.
19. H. Attias, "A variational Bayesian framework for graphical models," in Adv. Neural Inf. Process. Syst., 2000.
20. J. Besag, "Statistical analysis of non-lattice data," Statistician, vol.24, no.3, pp. 179-195, 1975.
21. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol.14, no.8, pp. 1771-1800, 2002.
22. A. Hyvärinen, "Estimation of non-normalized statistical models using score matching," J. Mach. Learn. Res., vol.6, pp. 695-709, 2005.
23. R. Kindermann and J. L. Snell, Markov Random Fields and Their Applications. Providence, RI: American Mathematical Society, 1980.
24. G. E. P. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis. Reading, MA: Addison-Wesley, 1973.
25. A. P. Dempster,N.M. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc., vol.1, no.39, pp. 1-38, 1977.
26. G. C. G. Wei and M. A. Tanner, "A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms," J. Amer. Statist. Assoc., vol.85, no.411, pp. 699-704, 1990.
27. M. A. Carreira-Perpiñán and G. E. Hinton, "On contrastive divergence learning," in Proc. 10th Int. Workshop Artif. Intell. Statist. (AISTATS 2005), 2005, pp. 59-66.
28. C. K. I. Williams and F. V. Agakov, "An analysis of contrastive divergence learning in Gaussian Boltzmann machines," Division of Informatics, University of Edinburgh, Tech. Rep. EDI-INF-RR-0120, 2002.
29. A. Hyvärinen, "Consistency of pseudolikelihood estimation of fully visible Boltzmann machines," Neural Comput., vol.18, no.10, pp. 2283-2292, 2006.
30. A.Yuille, "The convergence of contrastive divergences," in Adv. Neural Inf. Process. Syst. 17, 2005, pp. 1593-1600.
31. S. Mase, "Consistency of the maximum pseudo-likelihood estimator of continuous state space Gibbsian processes," Ann. Appl. Probability, vol.5, no.3, pp. 603-612, 1995.
32. B. Gidas, , W. Fleming and P.-L. Lions, Eds., "Consistency of maximum likelihood and pseudo-likelihood estimators for Gibbsian distributions," in Stochastic Differential Systems, Stochastic Control Theory and Applications. New York: Springer, 1988.
33. A. Hyvärinen, "Some extensions of score matching," Comput. Stat. Data Anal., vol.51, no.5, pp. 2499-2512, 2007.
34. G. E. P. Box and K. Wilson, "On the experimental attainment of optimum conditions (with discussion)," J R. Statist. Soc. Series B, vol.13, no.1, pp. 1-45, 1951.
35. O. Dikmen and A. T. Cemgil, Inference and Parameter Estimation in Gamma Chains Univ. of Cambridge, Tech. Rep. CUED/F-INFENG/ TR.596, Feb. 2008.
36. C. Févotte, R. Gribonval, and E. Vincent, "BSS-EVAL Toolbox User Guide," IRISA, Rennes, France, Tech. Rep. 1706, 2005.
37. T. O. Virtanen, A. T. Cemgil, and S. J. Godsill, "Bayesian extensions to nonnegative matrix factorisation for audio signal modelling," in Proc. IEEE ICASSP'08., Las Vegas, NV, 2008, pp. 1825-1828.