The forward search: Theory and data analysis

Journal of the Korean Statistical Society

Volumn 39, Issue 2, 2010, Pages 117-134

  Atkinson, Anthony C ^a   Riani, Marco ^b   Cerioli, Andrea ^b  

^a LONDON SCHOOL OF ECONOMICS   (United Kingdom)

^b UNIVERSITY OF PARMA   (Italy)

Author keywords

Box Cox transformation; Building models; Cp; Clustering; Constructed variable; Flexible trimming; Fraud detection; Kalman filter; Outliers; Ozone data; Robustness; Simultaneous inference

Indexed keywords

EID: 77952425342     PISSN: 12263192     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jkss.2010.02.007     Document Type: Review

References (79)

1. Andrews D.F., Bickel P.J., Hampel F.R., Tukey W.J., and Huber P.J. Robust estimates of location: survey and advances (1972), Princeton University Press, Princeton, NJ
2. Atkinson A.C. Testing transformations to normality. Journal of the Royal Statistical Society, Series B 35 (1973) 473-479
3. Atkinson A.C. Plots, transformations, and regression (1985), Oxford University Press, Oxford
4. Atkinson A.C. Fast very robust methods for the detection of multiple outliers. Journal of the American Statistical Association 89 (1994) 1329-1339
5. Atkinson A.C. Econometric applications of the forward search in regression: robustness, diagnostics and graphics. Econometric Reviews 28 (2009) 21-39
6. Atkinson A.C., and Riani M. Robust diagnostic regression analysis (2000), Springer-Verlag, New York
7. Atkinson A.C., and Riani M. Tests in the fan plot for robust, diagnostic transformations in regression. Chemometrics and Intelligent Laboratory Systems 60 (2002) 87-100
8. Atkinson A.C., and Riani M. Distribution theory and simulations for tests of outliers in regression. Journal of Computational and Graphical Statistics 15 (2006) 460-476
9. Atkinson A.C., and Riani M. Building regression models with the forward search. Journal of Computing and Information Technology-CIT 15 (2007) 287-294 10.2489/cit.1001135
10. Atkinson A.C., and Riani M. Exploratory tools for clustering multivariate data. Computational Statistics and Data Analysis 52 (2007) 272-285 10.1016/j.csda.2006.12.034
11. Atkinson A.C., and Riani M. A robust and diagnostic information criterion for selecting regression models. Journal of the Japanese Statistical Society 38 (2008) 3-14
12. Atkinson A.C., Riani M., and Cerioli A. Exploring multivariate data with the forward search (2004), Springer-Verlag, New York
13. Atkinson A.C., Riani M., and Cerioli A. Random start forward searches with envelopes for detecting clusters in multivariate data. In: Zani S., Cerioli A., Riani M., and Vichi M. (Eds). Data analysis, classification and the forward search (2006), Springer-Verlag, Berlin 163-171
14. Atkinson A.C., Riani M., and Cerioli A. Monitoring random start forward searches for multivariate data. In: Brito P. (Ed). COMPSTAT 2008 (2008), Physica-Verlag, Heidelberg 447-458
15. Barnett V., and Lewis T. Outliers in statistical data. 3rd ed. (1994), Wiley, New York
16. Becker C., and Gather U. The masking breakdown point of multivariate outlier identification rules. Journal of the American Statistical Association 94 (1999) 947-955
17. Beckman R.J., and Cook R.D. Outlier..........s (with discussion). Technometrics 25 (1983) 119-163
18. Box G.E.P. Non-normality and tests on variances. Biometrika 40 (1953) 318-335
19. Box G.E.P., and Cox D.R. An analysis of transformations (with discussion). Journal of the Royal Statistical Society, Series B 26 (1964) 211-246
20. Box G.E.P., and Watson G.S. Robustness to non-normality of regression tests. Biometrika 49 (1962) 93-106
21. Breiman L., and Friedman J.H. Estimating optimal transformations for multiple regression and transformation (with discussion). Journal of the American Statistical Association 80 (1985) 580-619
22. Casella G., and Berger R.L. Statstical inference. 2nd ed. (2002), Duxbury, Pacific Grove
23. Cerioli, A. (2010). Multivariate outlier detection with high-breakdown estimators. Journal of the American Statistical Association (in press).
24. Cerioli, A., & Farcomeni, A. (2010). Error rates for multivariate outlier detection. Unpublished manuscript (submitted for publication).
25. Cerioli A., and Riani M. Robust methods for the analysis of spatially autocorrelated data. Statistical Methods and Applications-Journal of the Italian Statistical Society 11 (2002) 335-358
26. Cerioli A., Riani M., and Atkinson A.C. Controlling the size of multivariate outlier tests with the MCD estimator of scatter. Statistics and Computing 19 (2009) 341-353
27. Chen C., and Liu L.-M. Joint estimation of model parameters and outlier effects in time series. Journal of the American Statistical Association 88 (1993) 284-297
28. Cheng T.-C., and Biswas A. Maximum trimmed likelihood estimator for multivariate mixed continuous and categorical data. Computational Statistics and Data Analysis 52 (2008) 2042-2065
29. Cook R.D., and Weisberg S. Residuals and influence in regression (1982), Chapman and Hall, London
30. Crosilla F., and Visentini D.F.S. An automatic classification and robust segmentation procedure of spatial objects. Statistical Methods and Applications 15 (2007) 329-341
31. de Jong P., and Penzer J. Diagnosing shocks in time series. Journal of the American Statistical Association 93 (1998) 796-806
32. Deng D., Joseph V.R., Sudjianto A., and Wu C.F.J. Active learning through sequential design, with applications to detection of money laundering. Journal of the American Statistical Association 104 (2009) 969-981
33. Forbes J.D. Further experiments and remarks on the measurement of heights by the boiling point of water. Transactions of the Royal Society of Edinburgh 21 (1857) 235-243
34. Fraley C., and Raftery A.E. Enhanced model-based clustering, density estimation and discriminant analysis: MCLUST. Journal of Classification 20 (2003) 263-286
35. García-Escudero L.A., and Gordaliza A. Generalized radius processes for elliptically contoured distributions. Journal of the American Statistical Association 100 (2005) 1036-1045
36. García-Escudero L.A., Gordaliza A., San Martin R., Van Aelst S., and Zamar R. Robust linear clustering. Journal of the Royal Statistical Society, Series B 71 (2009) 301-308
37. p-statistic. The Statistician 45 (1996) 49-56
38. Grossi L., and Laurini F. A robust forward weighted Lagrange multiplier test for conditional heteroscedasticity. Computational Statistics and Data Analysis 53 (2009) 2251-2263
39. Guenther W.C. An easy method for obtaining percentage points of order statistics. Technometrics 19 (1977) 319-321
40. Hadi A.S. Identifying multiple outliers in multivariate data. Journal of the Royal Statistical Society, Series B 54 (1992) 761-771
41. Hadi A.S. A modification of a method for the detection of outliers in multivariate samples. Journal of the Royal Statistical Society, Series B 56 (1994) 393-396
42. Hadi A.S., Imon A.H.M.R., and Werner M. Detection of outliers. Wiley Interdisciplinary Reviews: Computational Statistics 1 (2009) 57-70
43. Hadi A.S., and Simonoff J.S. Procedures for the identification of multiple outliers in linear models. Journal of the American Statistical Association 88 (1993) 1264-1272
44. Haegerty P., and Lumley T. Window subsampling of estimating functions with application to regression models. Journal of the American Statistical Association 95 (2000) 197-211
45. Hampel F.R. Beyond location parameters: Robust concepts and methods. Bulletin of the International Statistical Institute 46 (1975) 375-382
46. Hampel F., Ronchetti E.M., Rousseeuw P., and Stahel W.A. Robust statistics (1986), Wiley, New York
47. Hardin J., and Rocke D.M. The distribution of robust distances. Journal of Computational and Graphical Statistics 14 (2005) 910-927
48. Harvey A.C., and Koopman S.J. Diagnostic checking of unobserved components time series models. Journal of Business and Economic Statistics 10 (1992) 377-389
49. Hastie T., Tibshirani R., and Friedman J. The elements of statistical learning. Data mining, inference and prediction. 2nd ed. (2009), Springer, New York
50. Hawkins D.M. Identification of outliers (1980), Chapman and Hall, London
51. Hawkins D.M. Discussion of paper by Beckman and Cook. Technometrics 25 (1983) 155-156
52. Huber P.J. Robust statistics (1981), Wiley, New York
53. Huber P.J., and Ronchetti E.M. Robust statistics. 2nd ed. (2009), Wiley, New York
54. Hubert M., Rousseeuw P.J., and Van Aelst S. High-breakdown robust multivariate methods. Statistical Science 23 (2008) 92-119
55. Johnson N.L., Kotz S., and Balakrishnan N. Continuous univariate distributions-1. 2nd ed. (1994), Wiley, New York
56. p. Technometrics 15 (1973) 661-675
57. Maronna R.A., Martin R.D., and Yohai V.J. Robust statistics: Theory and methods (2006), Wiley, Chichester
58. Mavridis D., and Moustaki I. The forward search algorithm for detecting aberrant response patterns in factor analysis for binary data. Journal of Computational and Graphical Statistics 18 (2010) 1016-1034
59. Morgenthaler S. A survey of robust statistics. Statistical Methods and Applications 15 (2007) 271-293 Statistical Methods and Applications, 16, 171-172 (erratum)
60. Müller C., and Neykov N. Breakdown points of the trimmed likelihood and related estimators in GLMs. Journal of Statistical Planning and Inference 116 (2003) 503-519
61. Perrotta D., Riani M., and Torti F. New robust dynamic plots for regression mixture detection. Advances in Data Analysis and Classification 3 (2009) 263-279 10.1007/s11634-009-0050-y
62. Proietti T., and Riani M. Seasonal adjustment and transformations. Journal of Time Series Analysis 30 (2009) 47-69
63. Riani M. Extensions of the forward search to time series. Studies in Nonlinear Dynamics and Econometrics 8 (2004) 1-23
64. Riani M. Robust transformations in univariate and multivariate time series. Econometric Reviews 28 (2009) 262-278
65. Riani M., and Atkinson A.C. Fast calibrations of the forward search for testing multiple outliers in regression. Advances in Data Analysis and Classification 1 (2007) 123-141 10.1007/s11634-007-0007-y
66. Riani, M., & Atkinson, A. C. (2010). Robust model selection with flexible trimming. Computational Statistics and Data Analysis (in press).
67. Riani, M., Atkinson, A. C., & Cerioli, A. (2007). Results in finding an unknown number of multivariate outliers in large data sets. Research report 140. London School of Economics, Department of Statistics.
68. Riani M., Atkinson A.C., and Cerioli A. Finding an unknown number of multivariate outliers. Journal of the Royal Statistical Society, Series B 71 (2009) 447-466
69. Riani M., Cerioli A., Atkinson A., Perrotta D., and Torti F. Fitting mixtures of regression lines with the forward search. In: Fogelman-Soulié F., Perrotta D., Piskorski J., and Steinberger R. (Eds). Mining massive data sets for security (2008), IOS Press, Amsterdam 271-286
70. p. Journal of the American Statistical Association 89 (1994) 550-559
71. Rousseeuw P.J. Least median of squares regression. Journal of the American Statistical Association 79 (1984) 871-880
72. Rousseeuw P.J., and Leroy A.M. Robust regression and outlier detection (1987), Wiley, New York
73. Solaro N., and Pagani M. The forward search for classical multidimensional scaling when the starting data matrix is known. In: Lauro C., Palumbo F., and Greenacre M. (Eds). Data analysis and classification: From the exploratory to the confirmatory approach (2010), Springer-Verlag, Berlin 101-109
74. Tallis G.M. Elliptical and radial truncation in normal samples. Annals of Mathematical Statistics 34 (1963) 940-944
75. Torti, F., & Perrotta, D. (2010). Size and power of tests for regression outliers in the forward search. In: Ingrassia, S., Rocci, R., Vichi, M. (Eds.), New perspectives in statistical modeling and data analysis. Springer-Verlag, Heidelberg (in press).
76. Weisberg S. Applied linear regression. 3rd ed. (2005), Wiley, New York
77. Wilks S.S. Multivariate statistical outliers. Sankhya A 25 (1963) 407-426
78. Wisnowski J.W., Montgomery D.C., and Simpson J.R. A comparative analysis of multiple outlier detection procedures in the linear regression model. Computational Statistics and Data Analysis 36 (2001) 351-382
79. Zani S., Riani M., and Corbellini A. Robust bivariate boxplots and multiple outlier detection. Computational Statistics and Data Analysis 28 (1998) 257-270