Robust estimation in signal processing: A tutorial-style treatment of fundamental concepts

IEEE Signal Processing Magazine

Volumn 29, Issue 4, 2012, Pages 61-80

  Zoubir, Abdelhak M ^a   Koivunen, Visa ^b   Chakhchoukh, Yacine ^c   Muma, Michael ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b Smart Radios and Wireless Systems Centre of Excellence in Research   (Finland)

^c Darmstadt University of Technology ^*

Author keywords

[No Author keywords available]

Indexed keywords

ELECTRICAL ENGINEERING;

COMPARATIVE ANALYSIS; ENGINEERING PRACTICES; FUNDAMENTAL CONCEPTS; INDEPENDENTLY AND IDENTICALLY DISTRIBUTED; MULTICHANNEL ESTIMATION; OPTIMAL ESTIMATOR; SIMPLE DERIVATIONS; STATISTICAL ROBUSTNESS;

SIGNAL PROCESSING;

EID: 85032752065     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2012.2183773     Document Type: Article

References (79)

1. K. Kim and G. Shevlyakov, "Why Gaussianity?" IEEE Signal Processing Mag., vol. 25, no. 2, pp. 102-113, 2008.
2. T. K. Blankenship, D. M. Kriztman, and T. S. Rappaport, "Measurements and simulation of radio frequency impulsive noise in hospitals and clinics," in Proc. IEEE 47th Vehicular Technology Conf., 1997, vol. 3, pp. 1942-1946.
3. Y. I. Abramovich and P. Turcaj, "Impulsive noise mitigation in spatial and temporal domains for surface-wave over-the horizon radar," DTIC Document, Cooperative Research Centre for Sensor Signal and Information Processing, Mawson Lakes, Australia 1999.
4. D. Middleton, "Non-Gaussian noise models in signal processing for telecommunications: New methods and results for class A and class B noise models," IEEE Trans. Inform. Theory, vol. 45, no. 4, p. 1129, 1999, pp. 1129-1149.
5. P. C. Etter, Underwater Acoustic Modeling and Simulation. New York: Taylor & Francis, 2003.
6. D. C. Alexander, G. J. Barker, and S. R. Arridge, "Detection and modeling of non-Gaussian apparent diffusion coefficient profiles in human brain data," Magn. Reson. Med., vol. 48, no. 2, pp. 331-340, 2002. (Pubitemid 34809422)
7. U. Hammes, E. Wolsztynski, and A. M. Zoubir, "Robust tracking and geolocation for wireless networks in NLOS environments," IEEE J. Select. Topics Signal Processing, vol. 3, no. 5, pp. 889-901, Oct. 2009.
8. Y. Chakhchoukh, P. Panciatici, and L. Mili, "Electric load forecasting based on statistical robust methods," IEEE Trans. Power Syst., vol. 26, no. 3, pp. 982-991, 2010.
9. M. Nassar, K. Gulati, A. K. Sujeeth, N. Aghasadeghi, B. L. Evans, and K. R. Tinsley, "Mitigating near-field interference in laptop embedded wireless transceivers," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), 2008, pp. 1405-1408.
10. P. J. Huber and E. M. Ronchetti, Robust Statistics. Hoboken, NJ: Wiley, 2009.
11. S. M. Stigler, "Simon Newcomb, Percy Daniell and the history of robust estimation 1885-1920," J. Amer. Stat. Assoc., vol. 68, no. 344, pp. 872-879, 1973.
12. F. R. Hampel, E. M. Ronchetti, P. J. Rousseeuw, and W. A. Stahel, Robust Statistics: The Approach Based on Influence Functions. New York: Wiley, 1986.
13. S. A. Kassam and H. V. Poor, "Robust techniques for signal processing: A survey," Proc. IEEE, vol. 73, no. 3, pp. 433-481, 1985. (Pubitemid 15110686)
14. S. A. Kassam, Signal Detection in Non-Gaussian Noise (Springer Texts in Electrical Engineering). New York: Springer-Verlag, 1988.
15. H. V. Poor, An Introduction to Signal Detection and Estimation. Berlin: Springer-Verlag, 1994.
16. C. V. Stewart, "Robust parameter estimation in computer vision," SIAM Rev., vol. 41, no. 3, pp. 513-537, 1999. (Pubitemid 30538509)
17. G. Arce, Nonlinear Signal Processing: A Statistical Approach. Hoboken, NJ: Wiley, 2004.
18. P. C. Chandrasekharan, Robust Control of Linear Dynamical Systems. New York: Academic, 1996.
19. R. A. Maronna, R. D. Martin, and V. J. Yohai, Robust Statistics: Theory and Methods (Wiley Series in Probability and Statistics). Hoboken, NJ: Wiley, 2006.
20. E. Eskin, "Anomaly detection over noisy data using learned probability distributions," in Proc. Int. Conf. Machine Learning, 2000, pp. 255-262.
21. S. Chawla, D. Hand, and V. Dhar, "Outlier detection special issue," Data Min. Knowl. Discov., vol. 20, no. 2, pp. 189-190, 2010.
22. P. J. Rousseeuw and A. M. Leroy, Robust Regression and Outlier Detection. New York: Wiley, 1987.
23. V. Hodge and J. Austin, "A survey of outlier detection methodologies," Artif. Intell. Rev., vol. 22, no. 2, pp. 85-126, 2004.
24. C. L. Nikias and M. Shao, Signal Processing with Alpha-Stable Distributions and Applications. New York: Wiley, 1995.
25. F. Ruggeri, "Bayesian robustness," Newslett. Eur. Working Group Multiple Criteria Decis. Aiding, vol. 3, no. 17, pp. 6-10, 2008.
26. R. Brcich, C. L. Brown, and A. M. Zoubir, "An adaptive robust estimator for scale in contaminated distributions," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP). New York: IEEE, 2004, pp. 1049-1052.
27. X. Wang and H. V. Poor, "Robust multiuser detection in non-Gaussian channels," IEEE Trans. Signal Processing, vol. 47, no. 2, pp. 289-305, 1999.
28. A. M. Zoubir and R. F. Brcich, "Multiuser detection in heavy tailed noise," Digital Signal Processing, vol. 12, no. 2-3, pp. 262-273, 2002.
29. T.A. Kumar and K. D. Rao, "A new M-estimator based robust multiuser detection in flat-fading non-Gaussian channels," IEEE Trans. Commun., vol. 57, no. 7, pp. 1908-1913, 2009.
30. I. Guvenc and C. C. Chong, "A survey on TOA based wireless localization and NLOS mitigation techniques," IEEE Commun. Surveys Tutorials, vol. 11, no. 3, pp. 107-124, 2009.
31. J. C. Prieto, C. Croux, and A. R. Jiménez, "RoPEUS: A new robust algorithm for static positioning in ultrasonic systems," Sensors, vol. 9, no. 6, pp. 4211-4229, 2009.
32. M. Ye, R. M. Haralick, and L. G. Shapiro, "Estimating piecewise-smooth optical flow with global matching and graduated optimization," IEEE Trans. Pattern Anal. Machine Intell., vol. 25, no. 12, pp. 1625-1630, 2003.
33. L. Mili, M. G. Cheniae, and P. J. Rousseeuw, "Robust state estimation of electric power systems," IEEE Trans. Circuits Syst. I, vol. 41, no. 5, pp. 349-358, 2002.
34. L. Thomas and L. Mili, "A robust GM-estimator for the automated detection of external defects on barked hardwood logs and stems," IEEE Trans. Signal Processing, vol. 55, no. 7, pp. 3568-3576, 2007. (Pubitemid 47018839)
35. C. G. Bénar, D. Schön, S. Grimault, B. Nazarian, B. Burle, M. Roth, J. M. Badier, P. Marquis, C. Liegeois-Chauvel, and J. L. Anton, "Single-trial analysis of oddball event-related potentials in simultaneous EEG-fMRI," Hum. Brain Mapp., vol. 28, no. 7, pp. 602-613, 2007. (Pubitemid 47052614)
36. D. S. Pham and A. M. Zoubir, "A sequential algorithm for robust parameter estimation," IEEE Signal Processing Lett., vol. 12, no. 1, pp. 21-24, 2004.
37. I. Markovsky and S. Van Huffel, "Overview of total least-squares methods," Signal Process., vol. 87, no. 10, pp. 2283-2302, 2007. (Pubitemid 46855921)
38. U. Hammes, E. Wolsztynski, and A.M. Zoubir, "Transformation-based robust semiparametric estimation," IEEE Signal Processing Lett., vol. 15, no. 1, pp. 845-848, 2008.
39. D. S. Pham, A. M. Zoubir, R. F. Brcic, and Y. H. Leung, "A nonlinear M-estimation approach to robust asynchronous multiuser detection in non-Gaussian noise," IEEE Trans. Signal Processing, vol. 55, no. 5, pp. 1624-1633, 2007. (Pubitemid 46691617)
40. P. Stoica, H. Li, and J. Li, "Amplitude estimation of sinusoidal signals: Survey, new results, and an application," IEEE Trans. Signal Processing, vol. 48, no. 2, pp. 338-352, 2002.
41. A. F. Siegel, "Robust regression using repeated medians," Biometrika, vol. 69, no. 1, pp. 242-244, 1982.
42. P. J. Rousseeuw and V. J. Yohai, "Robust regression by means of S-estimators," Robust Nonlinear Time Ser. Anal., vol. 26, no. 1, pp. 256-272, 1984.
43. V. J. Yohai and R. H. Zamar, "High breakdown-point estimates of regression by means of the minimization of an efficient scale," J. Amer. Stat. Assoc., vol. 83, no. 402, pp. 406-413, 1988.
44. F. Gustafsson and F. Gunnarsson, "Mobile positioning using wireless networks: Possibilities and fundamental limitations based on available wireless network measurements," IEEE Signal Processing Mag., vol. 22, no. 4, pp. 41-53, 2005. (Pubitemid 41009633)
45. M. Salibian-Barrera and V. J. Yohai, "A fast algorithm for S-regression estimates," J. Comput. Graph. Stat., vol. 15, no. 2, pp. 414-427, 2006. (Pubitemid 43935985)
46. P. Schreier and L. Scharf, Statistical Signal Processing of Complex-Valued Data: The Theory of Improper and Noncircular Signals. Cambridge, U.K.: Cambridge Univ. Press, 2010.
47. E. Ollila and V. Koivunen, "Complex ICA using generalized uncorrelating transform," Signal Process., vol. 89, no. 4, pp. 365-377, 2009.
48. R. J. Kozick and B. M. Sadler, "Maximum-likelihood array processing in non-Gaussian noise with Gaussian mixtures," IEEE Trans. Signal Processing, vol. 48, no. 12, pp. 3520-3535, 2002. (Pubitemid 32085777)
49. M. Hubert, P. J. Rousseeuw, and S. Van Aelst, "High-breakdown robust multivariate methods," Stat. Sci., vol. 23, no. 1, pp. 92-119, 2008.
50. M. Salibian-Barrera, S. Van Aelst, and G. Willems, "Principal components analysis based on multivariate MM estimators with fast and robust bootstrap," J. Amer. Stat. Assoc., vol. 101, no. 475, pp. 1198-1211, 2006. (Pubitemid 44422618)
51. E. Ollila and V. Koivunen, "Influence functions for array covariance matrix estimators," in Proc. IEEE Workshop Statistical Signal Processing (SSP). New York: IEEE, 2003, pp. 462-465.
52. S. Visuri, V. Koivunen, and H. Oja, "Rank and sign covariance matrices," J. Stat. Plann. Inference, vol. 97, no. 2, pp. 557-575, 2000.
53. K. T. Fang, S. Kotz, and K. W. Ng, Symmetric Multivariate and Related Distributions. London, U.K.: Chapman & Hall, London, 1990.
54. J. Astola, P. Haavisto, and Y. Neuvo, "Vector median filters," Proc. IEEE, vol. 78, no. 4, pp. 678-689, 1990. (Pubitemid 20702858)
55. V. Koivunen, N. Himayat, and S. A. Kassam, "Nonlinear filtering techniques for multivariate images-Design and robustness characterization," Signal Process., vol. 57, no. 1, pp. 81-91, 1997. (Pubitemid 127443684)
56. V. Koivunen, "Nonlinear filtering of multivariate images under robust error criterion," IEEE Trans. Image Processing, vol. 5, no. 6, pp. 1054-1060, June 1996. (Pubitemid 126776759)
57. S. Kassam and J. Thomas, "A class of nonparametric detectors for dependent input data," IEEE Trans. Inform. Theory, vol. 21, no. 4, pp. 431-437, 1975.
58. Y. Chakhchoukh, "A new robust estimation method for ARMA models," IEEE Trans. Signal Processing, vol. 58, no. 7, pp. 3512-3522, July 2010.
59. R. Weron, Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach. Hoboken, NJ: Wiley 2006.
60. A. J. Fox, "Outliers in time series," J. Roy. Stat. Soc. B, vol. 34, pp. 350-363, 1972.
61. R. S. Tsay, "Outliers, level shifts, and variance changes in time series," Int. J. Forecast., vol. 7, no. 3, pp. 1-20, 1988.
62. G. E. P. Box, G. M. Jenkins, and G. C. Reinsel, Time Series Analysis: Forecasting and Control (Wiley Series in Probability and Statistics), 4th ed. Hoboken, NJ: Wiley, 2008.
63. R. H. Jones, "Maximum likelihood fitting of ARMA models to time series with missing observations," Technometrics, vol. 22, no. 3, pp. 389-395, 1980.
64. O. H. Bustos and V. J. Yohai, "Robust estimates for ARMA models," J. Amer. Stat. Assoc., vol. 81, no. 393, pp. 155-168, 1986.
65. Y. Chakhchoukh, P. Panciatici, and P. Bondon, "Robust estimation of SARIMA models: Application to short-term load forecasting," in Proc. IEEE Workshop Statistical Signal Processing (SSP), Cardiff, U.K., Aug. 2009, pp. 77-80.
66. N. Muler, D. Pena, and V. J. Yohai, "Robust estimation for ARMA models," Ann. Stat., vol. 37, no. 2, pp. 816-840, 2009.
67. R. D. Martin and V. J. Yohai, "Influence functionals for time series," Ann. Stat., vol. 14, no. 3, pp. 781-855, 1986.
68. H. Künsch, "Infinitesimal robustness for autoregressive processes," Ann. Stat., vol. 12, no. 3, pp. 843-863, 1984.
69. M. G. Genton and A. Lucas, "Comprehensive definitions of breakdown points for independent and dependent observations," J. Roy. Stat. Soc. B, vol. 65, no. 1, pp. 81-94, 2003. (Pubitemid 37155337)
70. Y. Yang, H. He, and G. Xu, "Adaptively robust filtering for kinematic geodetic positioning," J. Geodesy, vol. 75, no. 2, pp. 109-116, 2001.
71. M. A. Gandhi and L. Mili, "Robust Kalman filter based on a generalized maximum-likelihood-type estimator," IEEE Trans. Signal Processing, vol. 58, no. 5, pp. 2509-2520, 2010.
72. T. C. Aysal and K. E. Barner, "Meridian filtering for robust signal processing," IEEE Trans. Signal Processing, vol. 55, no. 8, pp. 3949-3962, 2007. (Pubitemid 47261518)
73. H. Dong, Z. Wang, and H. Gao, "Robust H̀ filtering for a class of nonlinear networked systems with multiple stochastic communication delays and packet dropouts," IEEE Trans. Signal Processing, vol. 58, no. 4, pp. 1957-1966, 2010.
74. R. D. Martin and D. J. Thomson, "Robust-resistant spectrum estimation," Proc. IEEE, vol. 70, no. 9, pp. 1097-1115, 1982.
75. B. Spangl and R. Dutter, "Estimating spectral density functions robustly," REVSTAT-Stat. J., vol. 5, no. 1, pp. 41-61, 2007.
76. T. H. Li, "A nonlinear method for robust spectral analysis," IEEE Trans. Signal Processing, vol. 58, no. 5, pp. 2466-2474, 2010.
77. K. Liang, X. Wang and T. H. Li, "Robust discovery of periodically expressed genes using the Laplace periodogram," BMC Bioinform., vol 10, no. 1, pp. 1-15, 2009.
78. R. Schmidt, "Multiple emitter location and signal parameter estimation," IEEE Trans. Antennas Propagat., vol. 34, no. 3, pp. 276-280, 1986. (Pubitemid 16613653)
79. S. Visuri, H. Oja, and V. Koivunen, "Nonparametric method for subspace based frequency estimation," in Proc. 10th European Signal Processing Conf. (EUSIPCO 2000), Tampere, Finland, 2000, pp. 1261-1264.