The bootstrap and its application in signal processing: An attractive tool for assessing the accuracy of estimators and testing hypothesis for parameters in small data-sample situations

IEEE Signal Processing Magazine

Volumn 15, Issue 1, 1998, Pages 56-76

  Zoubir, A M ^a   Boashash, B ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC EMISSIONS; COMPUTER SIMULATION; PARAMETER ESTIMATION; PROBABILITY; STATISTICAL METHODS;

BOOTSTRAP METHODS; STATISTICAL HYPOTHESIS;

SIGNAL PROCESSING;

EID: 0031677647     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/79.647043     Document Type: Article

References (75)

1. T.W. Anderson, An, Introduction to Multivariate Statistical Analysis. John Wiley New York, 1984.
2. C. Banga and F. Ghorbel, Optimal Bootstrap Sampling for Fast Image Segmentation: Application to Retina Image. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 93, Minnesota, 1993.
3. V.M. Bhide, M.J. Pivoso, and K.A. Kosanovich, Statistics on Reliability of Neural Networks Estimates. In Proceedings of the IEEE 1995 American Control Conference, volume 3, pages 1877-1881, Seattle, WA, USA, June 1995.
4. B. Boashash, Interpreting and Estimating the Instantaneous Frequency of a Signal - Part I: Fundamentals. Proceedings of the IEEE, pages 519-538, April 1992.
5. B. Boashash, Interpreting and Estimating the Instantaneous Frequency of a Signal - Part II: Algorithms. Proc. of the IEEE pages 539-569, April 1992.
6. J.F. Böhme and D. Maiwald, Multiple Wideband Signal Detection and Tracking from towed Array Data. In M. Blanke and T. Söderström, editors, STSID 94, 10th IFAC Symposium on System Identification, volume 1, pages 107-112, Copenhagen, July 4-6 1994. Danish Automation Soc.
7. A. Bose, Edgeworth Correction by Bootstrap in Autoregressions. The Annals of Statistics, 16: 1709-1722, 1988.
8. P. Bratley, B.L. Fox, and E.L. Schrage, A Guide to Simulation. Springer-Verlag, 1983.
9. D.R. Brillinger, Time Series: Data. Analysis and Theory. Expanded Edition Holden-Day San Francisco, 1981.
10. D.R. Brillinger. The Finite Fourier Transform of a Stationary Process. Handbook of Statistics, D.R. Brillinger and P.R., Krishnaiah, Editors, 3: 237-278, 1983.
11. P. Bühlmann, Blockwise Bootstrapped Empirical Process for Stationary Sequences. The Annals of Statistics, 22: 995-1012, 1994.
12. E. Carlstein, The Use of Subseries Values for Estimating the Variance of a General Statistic from a stationary sequence. The Annals of Statistics, 14: 1171-1179, 1986.
13. H. Cramér, Mathematical Methods for Statistics. Princeton University Press, 1966.
14. L. Dejian and C. Guanrong, Computing the Distribution of the Lyapunov Exponent from Time Series: The One-dimensional Case Study. International Journal of Bifurcation and Chaos in Applied Sciences and Engineering, 5: 172 1-1 726, 1995.
15. B. Efron, Bootstrap Methods. Another Look at the Jackknife. The Annals of Statistics, 7: 1-26, 1979.
16. B. Efron, Computers and the Theory of Statistics: Thinking the Unthinkable. SIAM Review, 4: 460-480, 1979.
17. B. Efron, Nonparametric Standard Errors and Confidence Intervals (with discussion). Can. J. Statist., 9: 1-26, 1981.
18. B. Efron, The Jackknife, the Bootstrap and Other Resampling Plans. CBMS Monograph 38, Society for Industrial and Applied Mathematics, Philadelphia, 1982.
19. B. Efron, Better Bootstrap Confidence Interval. J. Amer. Statist. Assoc., 82: 171-185, 1987.
20. B. Efron and B. Gong, A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation. Amer. Statist. 37: 36-48, 1983.
21. B. Efron and B. Tibshirani, An Introduction to the Bootstrap. Chapman and Hall, 1993.
22. B. Ferguson, A Ground based Narrow-band Passive Acoustic Technique for Estimating the Altitude and Speed of Propeller Driven Aircraft. The Journal of the Acoustical Society of America, 92(3), September 1992.
23. B.G. Ferguson, Doppler Effect for Sound Emitted by a Moving Airborne Source and Received by Acoustic Sensors located above and below the sea surface. The Journal of the Acoustical Society of America, 94(6), December 1993.
24. B.C. Ferguson and B.G. Quinn, Application of the Short-time Fourier Transform and the Wigner-Ville Distribution to the Acoustic Localization of Aircraft. The Journal of the Acoustical Society of America, 96(2), August 1994.
25. N.I. Fisher and P. Hall, Bootstrap Confidence Regions for Directional Data. J. Amer. Statist. Assoc., 84: 996-1002, 1989.
26. N.I. Fisher and P. Hall, New Statistical Methods for Directional Data -I. Bootstrap Comparison of Mean Directions and the Fold Test in Palaeomagnetism. Geophys. J. Int., 101: 305-313, 1990.
27. N.I. Fisher and P. Hall, General Statistical Test for the Effect of Folding. Geophys. J. Int., 105: 419-427, 1991.
28. R.A. Fisher, On the "Probable Error" of a Coefficient of Correlation Deduced from a Small Sample. Metron, 1: 1-32, 1921.
29. J. Franke and W. Hardle, On Bootstrapping Kernel Estimates. The Annals of Statistics, 20: 121-145, 1992.
30. B. Friedlander and B. Porat. The Sensitivity of High-order Parameter Estimation to Additive Gaussian Noise. In B. Boashash, E. J. Powers, and A. M. Zoubir, editors, Higher Order Statistical Signal Processing, pages 89-111. Longman Cheshire, 1995. ISBN 0 582 80077 3.
31. P. Hall, Theoretical Comparison of Bootstrap Confidence Intervals (with discussion). The Annals of Statistics, 16: 927-985, 1988.
32. P. Hall, The Bootstrap and Edgeworth Expansion. Springer-Verlag New York, Inc., 1992.
33. P. Hall, M. Martin, and W. R. Schucany, Better Nonparametric Bootstrap Confidence Intervals for the Correlation Coefficient. J. Statist. Comput. Simul., 33: 161-172, 1989.
34. P. Hall and D.M. Titterington, The Effect of Simulation Order on Level Accuracy and Power of Monte Carlo Tests. J. B. Statist. Soc. B, 51: 459-467, 1989.
35. P. Hall and S.R. Wilson, Two Guidelines for Bootstrap Hypothesis Testing. Biometrics, 47: 757-762, 1991.
36. S.R. Hanna, Confidence Limits for Air Quality Model Evaluations, as Estimated by Bootstrap and Jackknife Resembling Methods. Atmospheric Enrironment, 23: 1385-1398, 1989.
37. T. Hastie and R. Tibshirani, Generalized Additive Models. Chapman & Hall, 1990.
38. D.R. Haynor and S.D. Woods, Resampling Estimates of Precision in Emission Tomography. IEEE Transactions on Medical Imaging 8: 337-343, 1989.
39. M.G. Kendall and A. Stuart, The Advanced Theory of Statistics. Charles Griffin & Company Ltd., 1967.
40. D.E. Knuth, The Art of Computer Programming. Addison-Wesley, 1981.
41. J. Krolik, G. Niezgoda, and D. Swingler, A Bootstrap Approach for Evaluating Source Localization Performance on Real Sensor Array Data. In Proceedings of International Conference on Acoustics, Speech and Signal Processing, ICASSP' 91, volume 2, pages 1281-1284, Toronto, Canada, May 1991.
42. H.R. Künsch, The Jackknife and the Bootstrap for General Stationary Observations. The Annals of Statistics, 17: 1217-1241, 1989.
43. C. Léger, D.N. Politis, and J.P. Romano, Bootstrap Technology and Applications. Technometrics, 34: 378-398, 1992.
44. E.L. Lehmann, Testing Statistical Hypotheses. Second Edition John Wiley New York, 1986.
45. D. Maiwald and J.F. Böhme, Multiple Testing for Seismic Data Using Bootstrap. In Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, pages V 189-V192, Adelaide, 1994.
46. E.B. Manoukian, Modern Concepts and Theorems of Mathematical Statistics. Springer-Verlag, 1986.
47. R.G. Miller, The Jackknife - A Review. Biometrika, 61: 1-15, 1974.
48. S. Nagaoka and O. Amai, A Method for Establishing a Separation in Air Traffic Control Using a Radar Estimation Accuracy of Close Approach Probability. J. Japan Ins. Navigation, 82: 53-60, 1990.
49. S. Nagaoka and O. Amai, Estimation Accuracy of Close Approach Probability for Establishing a Radar Separation Minimum. J. Navigation, 44: 110-121, 1991.
50. Hall P. and B.Y. Jing. On Sample Re-use Methods for Dependent Data. J. R. Statist. Soc. B. 58: 727-737, 1996.
51. 5. K. Park and K.W. Miller, Random Number Generators: Good Ones are Hard to Kind. Comm. A.C.M., 32: 1192-1201, 1988.
52. D.N. Politis, Computer Intensive Methods in Statistical Analysis. IEEE Signal Processing Magazine, 15: 39-55, 1998.
53. D.N. Politis and J. P. Romano. A General Resampling Scheme for Triangular Arrays of α-Mixing Random Variables with Application to the Problem of Spectral Density Estimation. The Annals of Statistics, 20: 1985-2007, 1992.
54. D.N. Politis and J.P. Romano, Bootstrap Confidence Bands for Spectra and Cross-Spectra. IEEE Transactions on Signal Processing, 40: 1206-1215, 1992.
55. B. Porat and B. Friedlander, Performance Analysis of Parameter Estimation Algorithms Based on High-Order Moments. Int. J. Adaptive Control and Signal Processing, 3: 191-229, 1989.
56. M.B. Priestley, Spectral Analysis and Time Series. Academic Press London, 1981.
57. D.C. Reid and J.C. Ralston, An Optimum Window Length for the PWVD with Application to Passive Acoustic Parameter Estimation. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 94, volume IV, pages 313-16, Adelaide, Australia, April 1994.
58. D.C. Reid, A.M. Zoubir, and B. Boashash, Aircraft Parameter Estimation using the Polynomial Wigner-Ville Distribution. The Journal of the Acoustical Society of America, volume 102, number 1, pages 207-223, July 1997.
59. D.C. Reid, A.M. Zoubir, and B. Boashash, The Bootstrap Applied to Passive Acoustic Aircraft Parameter Estimation. In Proceedings of International Conference on Acoustics, Speech and Signal Processing, ICASSP' 96, volume VI, pages 3154-3157, Atlanta, May 1996.
60. Special Session. The Bootstrap and Its Applications. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, IC-ASSP 94, volume VI, pages 65-79, Adelaide, Australia 1994.
61. R.H. Shumway, Replicated Time-Series Regression: An Approach to Signal Estimation and Detection. In D.R. Brillinger and P.R. Krishnaiah, editors, Handbook of Statistics, volume 3, pages 383-408. North-Holland, 1983.
62. B.W. Silverman, Density Estimation for Statistics and Data Analysis. Chapman and Hall, 1986.
63. L. Tauxe, N. Kylstra, and C. Constable, Bootstrap Statistics for Paleomagnetic Data. J. Geophysical Research 96: 11723-11740, 1991.
64. J. Thomson and D. Chave, Jackknifed Error Estimates for Spectra, Coherence, and Transfer Functions. In S. Haykin, editor, Advances in Spectrum Analysis and Array Processing, volume 1, pages 58-113. Prentice Hall, 1991.
65. R. Tibshirani, Variance Stabilization and the Bootstrap. Biometrica, 75: 433-144, 1988.
66. R. Tibshirani, A Comparison of Some Error Estimates for Neural Network Models. Neural Computation, 8: 152-163, 1996.
67. G.A. Young, Bootstrap: More than a Stab in the Dark? Statistical Science, 9: 382-415, 1994.
68. Y. Zhang, D. Hatzinakos, and A.N. Venetsanopoulos, Bootstrapping techniques in the estimation of Higher-Order Cumulants from Short Data Records. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 93, volume IV, pages 200-203, Minnesota, 1993.
69. A.M. Zoubir, Bootstrap: Theory and Applications. In T. Luk, editor. Advanced Signal Processing Algorithms, Architectures and Implementations, volume 2027, pages 216-235, San Diego, July 1993. Proceedings of SPIE.
70. A.M. Zoubir, Multiple Bootstrap Tests and Their Application. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing ICASSP 94, volume VI, pages 69-72, Adelaide, Australia, 1994.
71. A.M. Zoubir and J.F. Böhme, Multiple Bootstrap Tests: An Application to Sensor Location. IEEE Transitions on Signal Processing, 43: 1386-1396, 1995.
72. A.M. Zoubir and D.R. Iskander, Bootstrapping Bispectra: An Application to Testing for the Departure from Gaussianity of Stationary Signals. IEEE Transactions on Signal Processing (under review). See also: A.M. Zoubir and D.R. Iskander, A Bispectrum Based Gaussianiry Test Using the Bootstrap. In Proceedings of International Conference of Acoustics, Speech and Signal Processing, ICASSP' 96, volume V, pages 3030-3033, Atlanta, May 1996.
73. A.M. Zoubir and D.R. Iskander, Bootstrapping Bispectra: An Application to Testing for the Departure from Gaussianity of Stationary Signals. IEEE Transactions on Signal Processing (under review). See also: A.M. Zoubir and D.R. Iskander, A Bispectrum Based Gaussianiry Test Using the Bootstrap. In Proceedings of International Conference of Acoustics, Speech and Signal Processing, ICASSP' 96, volume V, pages 3030-3033, Atlanta, May 1996.
74. A.M. Zoubir, D.R. Iskander, B. Ristic, and B. Boashash, Bootstrapping Confidence Bands for the Instantaneous Frequency. In T. Luk, editor, Advanced Signal Processing Algorithms, Architectures and Implementations, volume 2296, pages 176-190, San Diego, July 1994. Proceedings of SPIE.
75. A.M. Zoubir, Signal Detection Using the Bootstrap. Signal Processing (in press).