A review of robust regression and diagnostic procedures in linear regression

Acta Mathematicae Applicatae Sinica

Volumn 21, Issue 2, 2005, Pages 209-224

  Jajo, Nethal K ^a  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

Author keywords

Masking; Outliers; Robust estimator; Swamping

Indexed keywords

EID: 18244372161     PISSN: 01689673     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10255-005-0230-2     Document Type: Review

References (84)

1. Adichie, J. N. Estimation of regression parameters based on rank test. Ann. Math. Statist., 38: 849-904 (1967)
2. Agee, W.S., Turner, R.H. Application of robust regression to trajectory data reduction. In: robustness In Statistics (R.L. Launer and G.N. Wilkinson, eds), Academic Press, London, 1979
3. Agostinelli, C., Markatou, M. A one step robust estimator for regression based on the weighted likelihood reweighting scheme. Statist. Probab. Lett., 37: 341-350 (1998)
4. Alen, B.F. Robust estimation of straight line regression coefficient by minimizing pth power deviations. Technometrics, 14: 1-15 (1972)
5. Andrews, D.F. A robust method for multiple linear regression. Technometrics, 20: 255-263 (1974)
6. Andrews, D.F., Bickel, P.J., Hampel, F.R., Huber, P.J., Rogers, W.H., Tukey, J.W. Robust estimation of location. Princeton University Press, Princeton, N.J., 1972
7. Andrews, D.F. Significance test based on residuals. Biometrika, 58: 139-148 (1971)
8. Anscobe, F.J. Rejection of outliers. Technometrics, 2: 123-147 (1960)
9. Atkinson, A.C. Fast very robust methods for the detection of multiple outliers. JASA, 89: 1329-1339 (1994)
10. Barnett, V., Lewis, T. Outliers in statistical data. 3rd edition. John Wiley, New York, 1994
11. Beckman, R.J., Cook, R.D. Outlier ......s Technometrics, 25: 119-163 (1983)
12. Bernoulli, D. Dijndicatio maxime probabilis plurium observationum discrepantium atque verisimillima induction inde for manda. Acta Academiae Scientiorum Petropolitanae, 1: 3-33 (1777).
13. English translation by Allen, C.G. Biometrika, 48: 3-13 (1961)
14. Brown, R.L., Durbin, J., Evans, J.M. Techniques for testing the constancy of regression relationships overtime (with discussion). J. R. Statist. Soc. (Series B), 37: 149-192 (1975)
15. Chatterjee, S., Hadi, A.S. Influential observations, high leverage points, and outliers in linear regression. Statist. Sci., 1: 415-416 (1986)
16. Chatterjee, S., Hadi, A.S. Sensitivity analysis in linear regression. John Wiley, New York, 1988
17. Chen, E.H., Dixon, W.J. Estimation of parameters of a censored regression sample. JASA, 67: 664-671 (1972)
18. Chung, K.L. A course in probability (2nd. Ed.) Academic Press, New York, 1974
19. Clark, B.R., Godolphin, E.J. Uncorrelated residuals and exact test for two variance components in experimental design. Communication in Statistics, Part A-Theory and Methods, 21: 2501-2526 (1992)
20. Dileman, T.E. A comparison of forecasts from least absolute value and least squares regression. J. Forecasting, 5: 189-195 (1986)
21. 1 norm and related methods. North Holland, Amesterdam. 1987
22. Doornbos, R. Testing of a single outlier in linear model. Biometrics, 5: 705-712 (1981)
23. du Toit, S.H.C., Steyn, A.G.W., Stumpf, R.H. Graphical exploratory data analysis. Springer-Verlag, New York, 1986
24. Farebrother, R.W. An historical note on recursive residuals. J. R. Statist. Soc.(Series B), 40: 373-375 (1978)
25. Fernholz, L.T., Morgenthaler, S., Tukey, J.W. An outlier nomination method based on the multihalver. Journal of Statistical Planing and Inference, 122: 125-139 (2004)
26. Fung, W.K. Critical values for testing in multivariate statistical outliers. J. Statist. Comp. Sim., 30: 195-212 (1988)
27. Gentleman, J.F., Wilk, M.B. Detecting outliers II supplementing the direct analysis of residuals. Biometrics, 31: 387-410 (1975)
28. Gentleman, J.F., Wilk, M.B. Detecting outliers in a two-way table. In statistical behavior of residuals. Technometrics, 17: 1-14 (1975)
29. Gervini, D., Yohai, V.J. A class of robust and fully efficient regression estimators. The Annals of Statistics, 2: 583-616 (2002)
30. Guttman, I., Kraft, C.H. Robustness to spurious observations of linearized Hodges - Lehman estimators and Anscombe estimators. Technometrics, 22: 55-63 (1980)
31. Guttman, I., Smith, D.E. Investigation of rules for dealing with outliers in small samples from the normal distribution I Estimation of the mean. Technometrics, 11: 527-550 (1969)
32. Hadi, A.S., Simonoff, J.S. Procedures for the Identification of Multiple Outliers in Linear Models. JASA, 88: 1264-1272 (1993)
33. Hawkins, D.M. Critical values for identifying outliers. Letter to Applied Statistics, 29: 95-96 (1980b)
34. Hawkins, D.M. Identification of outliers. Chapman and Hall, London, 1980
35. Hettmansperger, T.P., Mckean, J.W., Sheather, S.J. Robust nonparametric methods. JASA, 95: 1308-1312 (2000)
36. Hill, R.W., Holland, P.W. A monte carlo study of two robust alternative to least squares regression estimates. Working-paper, 58, N.B. of Economic Research Cum. M. A., 1974
37. Hodges, J.L., Lehman, E.L. Estimates of locations based on rank tests. Ann. Math. Statist., 34: 598-611 (1963)
38. Huber, P.J. Between robustness and diagnostics. In: W. Stahed and S. Weisberg, eds., Directions in Robust Statistics and Diagnostics. Springer Verlag, New York, 1991
39. Huber, P.J. Robust estimation of a location parameter. Ann. Math. Statist., 35: 73-101 (1964)
40. Hussain, S.S., Sprent, P. Non-Parametric regression. J. R. Statist. Soc. A. part 2, 146: 182-191 (1983)
41. Jaeckel, L.A. Estimating regression coefficients by minimizing the dispresion of residuals. Ann. Math. Statis., 43: 1449-1458 (1972)
42. Jajo, N.K., Wu, X.Z. Robust diagnostics of outliers in linear regression. American Journal of Applied Science, 2: 136-148 (2004)
43. Jajo, N.K., Hussain, S.S. Robust estimators in linear regression model. Journal of Management and Economic, 10: 1-15 (1989)
44. Jajo, N.K. A comparative study of two robust alternatives to least squares estimatores. J. Engineering and Technology, 10: 23-28 (1993)
45. Jajo, N.K., Matawie, K.M., Wu, X.Z. Adaptive m-estimation procedure; adequacy and alternative approach. Advances in Statistics, Combinatorics and Related Areas; By Gulati, C., Lin, Y.X., Mishra, S., Rahner, J. World Scientific publisher, 2002, 133-142
46. Jajo, N.K. Graphical Display in Outlier diagnostics. Proceeding of barcelona conference on asymptotic statistics, September 2-6, 2003 at CRM, Bellaterra, 2003
47. James, W.W., Douglas, C.M., James, R.S. A comparative analysis of multiple outlier detection procedures in the linear regression model. Computation Statistics & Data Analysis, 36: 351-382 (2001)
48. Kent, J.T., Tyler, D.E. Constrained M-estimation for multivariate location and scatter. The Ann. of Statist., 24: 1346-1370 (1996)
49. Kianifard, F., Swallow, W.H. Using recursive residuals, calculated on adaptive-ordered observations, to identify outliers in linear regression. Biometrics, 45: 571-585 (1989)
50. Kianifard, F., Swallow, W.H. A review of the development and application of recursive residuals in linear models. Journal of the American Statistical Association, 91: 391-400 (1996)
51. Kildea, D.G. Estimators of regression models-the brown-mood approach. Ph.D. Thesis, Latrobe University, Melbourne, Australia, 1978
52. Lund, R.E. Tables of an approximate test for outliers in linear models. Technometrics, 17: 473-476 (1975)
53. Mallows, C.L. On some ttopics in robustness. Technical memorandum, Bell telephone Labratories, Murray Hill, NJ, 1975
54. Marasinghe, M.G. A multistage procedure for detecting several outliers in linear regression. Technometrics, 27: 395-399 (1985)
55. McKean, J.W., Sivers, G.L. Coefficients of determination for least absolute deviation analysis. Statist. Prob. Lett., 5: 49-54 (1987)
56. Mendeleev, D.I. Course of work on the renewal of prototypes or standard measures of lenghts and weights (Russian). Vremennik Glavnoi Palaty Mer i Vesov, 2: 157-185 (1895)
57. Moberg, T.F., Ramberg, T.S., Randles, R.H. An adaptive M-estimator and its application to a selection problem. Technometrics, 20: 225-263 (1978)
58. Moberg, T.F., Ramberg, T.S., Randles, R.H. An adaptive multiple procedure basede on m-estimators. Technometrics, 22: 213-224 (1980)
59. Mood, A.M. Introduction to the theory of statistics. McGraw-Hill Book company, New York, 1950
60. Morgenthaler, S. The Multihalver. A talk given at INTERNATIONAL CONFERENCE OF ROBUST STatistics, May 12-18, 2002.
61. Moussa-Hamouda, E., Leone, F.C. The robutness of efficiency of adjusted trimmed estimators in linear regression. Technometrics, 19: 19-34 (1977)
62. Naranjo, J.D., Hattmansperger, T.P. Bounded-infuence rank regression. Journal of the Royal Statistical Society Series B, 56: 209-220 (1994)
63. Peirce, B. Criterion of the rejection of doubtful observations. Astr. J., 2: 161-163 (1852)
64. Ramsy, J.O. A comparative study of several robust estimators of slope, intercept and scale in linear regression. JASA, 72: 608-615 (1977)
65. Peña, D., Yohai, V.J. A procedure for robust estimation and diognostics in regression. Working paper, University Carlos III de Madrid, 1996
66. Peña, D., Yohai, V.J. A fast procedure for outlier diagnostics in linear regression problems. JASA, 94: 434-445 (1999)
67. Perscott, P. An approximate test for outliers in linear models. Technometrics, 17: 129-132 (1975)
68. Rousseeuw, P.J., Bassett, G.W. The Remedian a robust averaging method for large data sets. JASA, 85: 97-104 (1990)
69. Rousseeuw, P.J., Leroy, A.M. Robust regression and outlier detection. Wiley, New York, 1987
70. Scholz, F.W. Weighted median regression estimate. The Annals of Statis., 6: 603-609 (1978)
71. Sen, P.K. Invariance principles for recursive residuals. The Annals of Statistics, 10: 307-312 (1982)
72. Sieveres, G.L. Weighted rank statistics for simple linear regression. JASA, 73: 628-631 (1978)
73. Simpson, D.G., Ruppert, D., Carroll, R.J. On one-step gm estimates and stability of inferences in linear regression. JASA, 87: 439-450 (1992)
74. Simpson, D.G., Yohai, V.J. Functional stability of one-step gm-estimators in approximately linear regression. The Annals of Statistics, 26: 1147-1169 (1998)
75. Srikanata, K.S. Teasting for the single outlier in a regression model. Sankhyã (Series A), 23: 251-260 (1961)
76. Swallow, W.H., Kianifard, F. Using a robust scale estimates in detecting multiple outliers in linear regression. Biometrics, 52: 545-556 (1996)
77. Theil, H. A rank invariant method of linear and polynomial regression analysis, I, II, III. Proc. Kon. Nederl. Akad. Wetensch. A., 53: 386-392, 521-525, 1897-1912 (1950)
78. Theil, H. The analysis of disturbances in regression analysis. JASA, 60: 1067-1079 (1965)
79. Theil, H. Principles of econometrics. John Wiley, New York, 1971
80. Tietjen, G.L., Moor, R.H., Beckman, R.J. Testing for a single outlier in simple linear regression. Technometrics, 15: 717-721 (1973)
81. Tiku, M.L. Linear regression model with censored observations. Commun. Statist. Theor. Meth., 17: 1219-1232 (1978)
82. Tse, Y.K. Assessing Lund's critical values for testing for outliers in linear regression models. J. Appl. Statist., 15: 363-366 (1988)
83. Tukey, J.W. The ninther, a technique for low-effort robust (resistant) location in large samples, p. 251-257 of David, H.A. (Ed.) (1978) contributions to Survey Sampling and Applied Statistics, in honour of H. O. Hartley. Academic Press, New York, 1978
84. Velilla, S. A note on the behavior of residual plots in regression. Statistics and Probability Letters, 37: 269-278 (1998)