Statistical reconstruction and analysis of autoregressive signals in impulsive noise using the Gibbs sampler

IEEE Transactions on Speech and Audio Processing

Volumn 6, Issue 4, 1998, Pages 352-372

  Godsill, Simon J ^a   Rayner, Peter J W ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Bayesian; Gibbs sampler; Impulsive noise; Nongaussian

Indexed keywords

COMPUTATIONAL COMPLEXITY; CORRELATION THEORY; MARKOV PROCESSES; MATHEMATICAL MODELS; MONTE CARLO METHODS; REGRESSION ANALYSIS;

GIBBS SAMPLER; IMPULSIVE NOISE; SIGNAL RECONSTRUCTION;

SPURIOUS SIGNAL NOISE;

EID: 0032122676     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/89.701365     Document Type: Article

References (62)

1. P. Mertz, "Model of impulsive noise for data transmission," IRE Trans. Commun. Syst., vol. 9, pp. 130-137, June 1961.
2. S. S. Rappaport and L. Kurz, "An optimal nonlinear detetector for digital data transmission through non-Gaussian channels," IEEE Trans. Commun. Technol., vol. COM-14, pp. 266-274, 1966.
3. B. W. Stuck and B. Kleiner, "A statistical analysis of telephone noise," Bell Syst. Tech. J., vol. 53, pp. 1263-1320, 1974.
4. F. \V. Machell, C. S. Penrod, and G. E. Ellis, "Statistical characteristic of ocean acoustic noise processes," in Topics in Non-Gaussian Signal Processing. Berlin, Germany: Springer-Verlag, 1989, pp. 29-57.
5. M. J. Carrey and I. Buckner, "A system for reducing impulsive noise on gramophone reproduction equipment," Radio Electron. Eng., vol. 50, pp. 331-336, July 1976.
6. G. R. Kinzie, Jr. and D. W. Gravereaux, "Automatic detection of impulse noise," J. Audio Eng. Soc., vol. 21, pp. 331-336, Apr. 1973.
7. [71 B. Mandelbrot, "The variation of certain speculative prices," J. Business, vol. 36, pp. 394-419, 1963.
8. V. Barnett and T. Lewis, Outliers in Statistical Data, 2nd ed. New York: Wiley, 1984.
9. F. Mosteller and J. W. Tukey, Data Analysis and Regression. Reading, MA: Addison-Wesley, 1977.
10. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
11. [II] R. D. Martin and D. J. Thompson, "Robust-resistant spectrum estimation," in Proc. IEEE, vol. 70, pp. 1097-1115, 1982.
12. S. R. Kim and A. Efron, "Adaptive robust noise filtering," IEEE Trans. Signal Processing, vol. 43, pp. 1855-1866, 1995.
13. K. Arakawa et al., "Separation of a nonstationary component from the EEC by a nonlinear digital filter," IEEE Trans. Biomed. Eng., vol. BME-33, pp. 724-726, 1986.
14. S. J. Godsill, P. J. W. Rayner, and O. Cappé, "Digital audio restoration," in Applications of Digital Signal Processing to Audio and Acoustics, K. Brandenburg and M. Kahrs, Eds. Boston, MA: Kluwer, 1998.
15. S. V. Vaseghi and P. J. Rayner, "Detection and suppression of impulsive noise in speech communication systems," Proc. Inst. Elect. Eng., vol. 137, pp. 38-16, Feb. 1990.
16. S. J. Godsill and P. J. W. Rayner, "A Bayesian approach to the detection and correction of bursts of errors in audio signals," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, pp. 261-264, San Francisco, CA, Mar. 1992.
17. _, "A Bayesian approach to the restoration of degraded audio signals," IEEE Trans. Speech and Audio Processing, vol. 3, pp. 267-278, July 1995.
18. H. Jeffreys, Theory of Probability. Oxford, U.K.: Oxford Univ. Press, 1939.
19. R. T. Cox, "Probability, frequency, and reasonable expectation," Amer. J. Phys., vol. 14, pp. 1-13, 1946.
20. G. E. P. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis. Reading, MA: Addison-Wesley, 1973.
21. J. M. Bernardo and A. F. M. Smith, Bayesian Theory. New York: Wiley, 1994.
22. M. A. Tanner, Tools for Statistical Inference, 2nd ed. Berlin, Germany: Springer-Verlag, 1993.
23. N. Metropolis, et al., "Equations of state calculations by fast computing machines," J. Ciiem. Phys., vol. 21, pp. 1087-1091, 1953.
24. W. K. Hastings, "Carlo sampling methods using Markov chains and their applications," Biometrika, vol. 57, pp. 97-109, 1970.
25. L. Tiemey, "Markov chains for exploring posterior distributions (with discussion)," Ann Stat., vol. 22, pp. 1701-1762, 1994.
26. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, 1984.
27. A. E. Gelfand and A. F. M. Smith, "Sampling-based approaches to calculating marginal densities," J. Amer. Stat. Assoc., vol. 85, pp. 398-409, 1990.
28. J. Liu, W. H. Wong, and A. Kong, "Covariance structure of the Gibbs sampler with applications to the comparison of estimators and augmentation schemes," Biometrika, vol. 81, pp. 27-40, 1994.
29. G. O. Roberts, "Markov chain concepts related to sampling algorithms," in Markov Chain Monte Carlo in Practice, W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds. London, U.K.: Chapman & Hall, 1996, pp. 45-57.
30. M. K. Cowles and B. P. Carlin, "Markov chain Monte Carlo convergence diagnostics: A comparative review," Res. Rep. 94-008, Univ. Minnesota, Minneapolis, July 1994.
31. B. P. Carlin, N. G. Poison, and D. S. Stoffer, "A Monte Carlo approach to rionormal and nonlinear state-space modeling," J. Amer. Stat. Assoc., vol. 87, pp. 493-500, June 1992.
32. R. E. McCulIoch and R. S. Tsay, "Bayesian inference and prediction for mean and variance shifts in autoregressive time series," J. Amer. Stat. Assoc., vol. 88, pp. 968-978, 1993.
33. _, "Bayesian analysis of autoregressive time series via the Gibbs sampler,"J. Tune Series Anal., vol. 15, pp. 235-250, 1994.
34. J. J. K. ÖRuanaidh and W. J. Fitzgerald, "Interpolation of missing samples for audio restoration," Electron. Lett., vol. 30, Apr. 1994.
35. N. Shephard, "Partial non-Gaussian state space," Biometrika, vol. 81, pp. 115-131, 1994.
36. C. K. Carter and R. Kohn, "Markov chain Monte Carlo in conditionally Gaussian state space models," Biometrika, vol. 83, pp. 589-601, 1996.
37. G. E P. Box and G. M. Jenkins, Time Series Analysis, Forecasting and Control. San Francisco, CA: Holden-Day, 1970.
38. M. B. Priestley, Spectral Analysis and Time Series. New York: Academic, 1981.
39. J. J. Rajan, P. J. W. Rayner, and S. J. Godsill, "A Bayesian approach to parameter estimation and interpolation of time-varying autoregressive processes using the Gibbs sampler," IEE Proc. Vfj., Image, Signal Processing, vol. 144, no. 4,Aug. 1997.
40. S. J. Godsill and P. J. W. Rayner, "Robust noise reduction for speech and audio signal," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, May 1996.
41. S. J. Godsill, "Bayesian enhancement of speech and audio signals which can be modeled as ARMA processes," Int. Stat. Rev., vol. 65, pp. 1-21, 1997.
42. N. L. Johnson and S. Kotz, Distributions in Statistics: Continuous Univariate Distributions. New York: Wiley, 1970.
43. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vettereling, Numer. Recipes C, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1992.
44. M. West, "Outlier models and prior distributions in Bayesian linear regression," J. R. Stat. Soc. B, vol. 46, pp. 431-439, 1984.
45. D. F. Andrews and C. L. Mallows, "Scale mixtures of normal distributions," J. R. Stat. Soc. B, vol. 36, pp. 99-102, 1974.
46. M. West, "On scale mixtures of normal distributions," Biometrika, vol. 74, pp. 99-102, 1987.
47. H. M. Hall, "The generalized T model for impulsive noise," in Proc. Int. Symp. Information Theory, 1970.
48. C. L. Nikias and M. Shao, Signal Processing with a-Stable Distributions and Applications. New York: Wiley, 1995.
49. S. J. Godsill, The Restoration of Degraded Audio Signal, Ph.D. dissertation, Dept. Eng., Cambridge Univ., Cambridge, U.K., Dec. 1993.
50. E. N. Gilbert, "Capacity of a burst-noise channel," Bell Syst. Tech. J., 1960, pp. 1253-1265.
51. P. Bratley, B. L. Fox, and E. L. Schräge, A Guide to Simulation. Berlin, Germany: Springer-Verlag, 1983.
52. P. J. W. Rayner and S. J. Godsill, "The detection and correction of artefacts in archived gramophone recordings," in Proc. IEEE Workshop on Audio and Acoustics, Mohonk, NY, Oct. 1991.
53. E. I. George and R. E. McCulloch, "Variable selection via Gibbs sampling," J. Amer. Slat. Assoc., vol. 88, pp. 881-889, Sept. 1993.
54. C. K. Carter and R. Kohn, "On Gibbs sampling for state space models," Biometrika, vol. 81, pp. 541-553, 1994.
55. G. O. Roberts and A. F. M. Smith, "Simple conditions for the convergence of the Gibbs sampler and Metropolis Hastings algorithms," Stochast.Processes Appl, no. 49, pp. 207-216, 1994.
56. J. J. K. ÖRuanaidh and W. J. Fitzgerald, Numerical Bayesian Methods Applied to Signal Processing. Berlin, Germany: Springer-Verlag, 1996.
57. B. D. O. Anderson and J. B. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice-Hall, 1979.
58. S. Fruhwirth-Schnatter, "Data augmentation and dynamic linear models," J. Time Series Anal., vol. 15, pp. 183-202, 1994.
59. P. de long and N. Shephard, 'The simulation smoother for time series models," Biometrika, vol. 82, pp. 339-350, 1995.
60. J. Makhoul, "Linear prediction: A tutorial review," in Proc. IEEE, vol. 63, pp. 561-580, 1975.
61. M. K. Cowles and B. P. Carlin, "Markov chain Monte Carlo convergence diagnostics: A comparative review," J. Amer. Stat. Assoc., 1996.
62. A. Gelman, "Inference and monitoring covergence," in Markov Chain ' Monte Carlo in Practice, W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds.. London, U.K.: Chapman & Hall, 1996, pp. 132-143.