Bayesian variable selection and regularization for time-frequency surface estimation

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 66, Issue 3, 2004, Pages 575-589

  Wolfe, Patrick J ^a   Godsill, Simon J ^a   Ng, Wee Jing ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Bayesian inference; Gabor frames; Model selection; Regression; Regularization

Indexed keywords

EID: 3543026876     PISSN: 13697412     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2004.02052.x     Document Type: Article

References (54)

1. Abramovich, F., Sapatinas, T. and Silverman, B. W. (1998) Wavelet thresholding via a Bayesian approach. J. R. Statist. Soc. B, 60, 725-749.
2. Barnett, G., Kohn, R. and Sheather, S. (1996) Bayesian estimation of an autoregressive model using Markov chain Monte Carlo. J. Econometr., 74, 237-254.
3. Bernardo, J. M. and Smith, A. F. M. (1994) Bayesian Theory. Chichester: Wiley.
4. Besag, J. E. (1974) Spatial interaction and the statistical analysis of lattice systems (with discussion). J. R. Statist. Soc. B, 36, 192-236.
5. Brown, P. J., Vannucci, M. and Fearn, T. (1998) Multivariate Bayesian variable selection and prediction. J. R. Statist. Soc. B, 60, 627-641.
6. Brown, P. J., Vannucci, M. and Fearn, T. (2002) Bayes model averaging with selection of regressors. J. R. Statist. Soc. B, 64, 519-536.
7. Carter, C. K. and Kohn, R. (1997) Semiparametric Bayesian inference for time series with mixed spectra. J. R. Statist. Soc. B, 59, 255-268.
8. Chen, S. S., Donoho, D. L. and Saunders, M. A. (2001) Atomic decomposition by basis pursuit. SIAM Rev., 43, 129-159.
9. Chipman, H. A., Kolaczyk, E. D. and McCulloch, R. E. (1997) Adaptive bayesian wavelet shrinkage. J. Am. Statist. Ass., 92, 1413-1421.
10. Clyde, M., Parmigiani, G. and Vidakovic, B. (1998) Multiple shrinkage and subset selection in wavelets. Biometrika, 85, 391-401.
11. Coifman, R. R. and Meyer, Y. (1991) Remarques sur l'analyse de Fourier à fenêtre. C. R. Acad. Sci., 312, 259-261.
12. Crouse, M. S., Nowak, R. D. and Baraniuk, R. G. (1998) Wavelet-based statistical signal processing using hidden Markov models. IEEE Trans. Signal Process., 46, 886-902.
13. Daubechies, I., Jaffard, S. and Journé, J.-L. (1991) A simple Wilson orthonormal basis with exponential decay. SIAM J. Math Anal., 22, 554-573.
14. Donoho, D. L. and Huo, X. (1999) Uncertainty principles and ideal atomic decompositions. Technical Report 1999-13. Department of Statistics, Stanford University, Stanford.
15. Donoho, D. L., Vetterli, M., Daubechies, I. and DeVore, R. A. (1998) Data compression and harmonic analysis. IEEE Trans. Inform. Theory, 44, 2435-2476.
16. Dörfler, M. (2001) Time-frequency analysis for music signals: a mathematical approach. J. New Mus. Res., 30, 3-12.
17. Doucet, A., de Freitas, J. F. G. and Gordon, N. J. (eds) (2001) Sequential Monte Carlo Methods in Practice. New York: Springer.
18. Feichtinger, H. G. and Strohmer, T. (eds) (1998) Gabor Analysis and Algorithms: Theory and Applications. Boston: Birkhäuser.
19. Figueiredo, M. A. T. (2001) Adaptive sparseness using Jeffreys prior. In Advances in Neural Information Processing Systems, vol. 14 (eds T. G. Dietterich, S. Becker and Z. Ghahramani). Cambridge: MIT Press.
20. Gallant, A. R. and Monahan, J. F. (1985) Explicitly infinite-dimensional Bayesian analysis of production technologies. J. Econometr., 30, 171-201.
21. Geman, S. and Geman, D. (1984) Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. Pattn Anal. Mach. Intell., 6, 721-741.
22. George, E. I. and McCulloch, R. E. (1993) Variable selection via Gibbs sampling. J. Am. Statist. Ass., 88, 881-889.
23. George, E. I. and McCulloch, R. E. (1997) Approaches for Bayesian variable selection. Statist. Sin., 7, 339-373.
24. Gilks, W. R., Richardson, S. and Spiegelhalter, D. J. (eds) (1996) Markov Chain Monte Carlo in Practice. London: Chapman and Hall.
25. Giovannelli, J.-F. and Idier, J. (2001) Bayesian interpretation of periodograms. IEEE Trans. Signal Process., 49, 1388-1396.
26. Godsill, S. J. (1999) MCMC and EM-based methods for inference in heavy-tailed processes with alpha-stable innovations. In Proc. Institute of Electrical and Electronic Engineers Signal Processing Wrkshp Higher-order Statistics, Caesarea. New York: Institute of Electrical and Electronic Engineers.
27. Godsill, S. J. (2001) On the relationship between MCMC model uncertainty methods. J. Comput. Graph. Statist., 10, 230-248.
28. Godsill, S. J. and Rayner, P. J. W. (1998) Robust reconstruction and analysis of autoregressive signals in impulsive noise using the Gibbs sampler. IEEE Trans. Speech Audio Process., 6, 352-372.
29. Gröchenig, K. (2001) Foundations of Time-Frequency Analysis. Boston: Birkhäuser.
30. Kozek, W. (1998) Adaptation of Weyl-Heisenberg frames to underspread environments. In Gabor Analysis and Algorithms: Theory and Applications (eds H. G. Feichtinger and T. Strohmer), ch. 10, pp. 323-352. Boston: Birkhäuser.
31. Lenk, P. J. (1999) Bayesian inference for semiparametric regression using a Fourier representation. J. R. Statist. Soc. B, 61, 863-879.
32. Lewicki, M. S. and Sejnowski, T. J. (2000) Learning overcomplete representations. Neur. Computn, 12, 337-365.
33. Mallat, S. G. and Zhang, Z. (1993) Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Process., 41, 3397-3415.
34. Malvar, H. S. (1990) Lapped transforms for efficient transform/subband coding. IEEE Trans. Speech Audio Process., 38, 969-978.
35. Marron, J. S., Adak, S., Johnstone, I. M., Neumann, M. H. and Patil, P. (1998) Exact risk analysis of wavelet regression. J. Comput. Graph. Statist., 7, 278-309.
36. Mitchell, T. J. and Beauchamp, J. J. (1988) Bayesian variable selection in linear regression (with discussion). J. Am. Statist. Ass., 83, 1023-1036.
37. Müller, P. and Vidakovic, B. (eds) (1999) Bayesian inference in wavelet-based models. Lect. Notes Statist., 141.
38. Nason, G. P., von Sachs, R. and Kroisandt, G. (2000) Wavelet processes and adaptive estimation of the evolutionary wavelet spectrum. J. R. Statist. Soc. B, 62, 271-292.
39. Ng, W.-J. (2000) Noise reduction for audio signals using the Gabor expansion. MPhil Thesis. University of Cambridge, Cambridge.
40. Olshausen, B. A. and Millman, K. J. (2000) Learning sparse codes with a mixture-of-Gaussians prior. In Advances in Neural Information Processing Systems, vol. 12 (eds S. A. Solla, T. K. Leen and K.-R. Müller), pp. 841-847. Cambridge: MIT Press.
41. Poggio, T. and Girosi, F. (1998) A sparse representation for function approximation. Neur. Computn, 10, 1445-1454.
42. Priestley, M. B. (1981) Spectral Analysis and Time Series. London: Academic Press.
43. Ripley, B. D. (1988) Statistical Inference for Spatial Processes. Cambridge: Cambridge University Press.
44. Robert, C. P. and Casella, G. (1999) Monte Carlo Statistical Methods. New York: Springer.
45. Strohmer, T. (1998) Numerical algorithms for discrete Gabor expansions. In Gabor Analysis and Algorithms: Theory and Applications (eds H. G. Feichtinger and T. Strohmer), ch. 8, pp. 267-294. Boston: Birkhäuser.
46. Tipping, M. E. (2001) Sparse Bayesian learning and the relevance vector machine. J. Mach. Learnng Res., 1, 211-244.
47. Vidakovic, B. (1998) Nonlinear wavelet shrinkage with Bayes rules and Bayes factors. J. Am. Statist. Ass., 93, 173-179.
48. Vidakovic, B. (1999) Statistical Modeling by Wavelets. New York: Wiley.
49. Wahba, G. (1983) Bayesian " confidence intervals " for the cross-validated smoothing spline. J. R. Statist. Soc. B, 45, 133-150.
50. West, M. (2003) Bayesian factor regression models in the 'large p, small n' paradigm. In Bayesian Statistics 7 (eds J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West), pp. 733-742. Oxford: Oxford University Press.
51. Wilson, K. G. (1987) Generalized Wannier functions. Preprint. Cornell University, Ithaca.
52. Wolfe, P. J. (2003) Perceptually motivated approaches to audio signal enhancement: broad-band noise reduction via Bayesian modelling of time-frequency coefficients. PhD Thesis. University of Cambridge, Cambridge.
53. Wolfe, P. J., Dörfler, M. and Godsill, S. J. (2001) Multi-Gabor dictionaries for audio time-frequency analysis. In Proc. Institute of Electrical and Electronic Engineers Wrkshp Applications of Signal Processing to Audio and Acoustics, pp. 43-46. New York: Institute of Electrical and Electronic Engineers.
54. Wolfe, P. J. and Godsill, S. J. (2003) Bayesian estimation of time-frequency coefficients for audio signal enhancement. In Advances in Neural Information Processing Systems, vol. 15 (eds S. Becker, S. Thrun and K. Obermayer). Cambridge: MIT Press.