Outlier detection using nonconvex penalized regression

Journal of the American Statistical Association

Volumn 106, Issue 494, 2011, Pages 626-639

  She, Yiyuan ^a   Owen, Art B ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

M estimation; Robust regression; Sparsity; Thresholding

Indexed keywords

EID: 79960141467     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2011.tm10390     Document Type: Article

References (42)

1. Antoniadis, A. (2007), "Wavelet Methods in Statistics: Some Recent Developments and Their Applications," Statistics Surveys, 1, 16-55. [628,629,638]
2. Antoniadis, A., and Fan, J. (2001), "Regularization of Wavelets Approximations," Journal of the American Statistical Association, 96, 939-967. [630,631]
3. Atkinson, A. C., and Riani, M. (2000), Robust Diagnostic Regression Analysis, New York: Springer-Verlag. [627]
4. Benjamini, Y., and Hochberg, Y. (1995), "Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing," Journal of the Royal Statistical Society, Ser. B, 57 (1), 289-300. [636]
5. Brown, P. (1993), Measurements, Regression and Calibration, Oxford: Oxford University Press. [636]
6. Brown, P. J., Vannucci, M., and Fearn, T. (1998), "Multivariate Bayesian Variable Selection and Prediction," Journal of the Royal Statistical Society, Ser. B, 60 (3), 627-641. [636]
7. Chen, J., and Chen, Z. (2008), "Extended Bayesian Information Criterion for Model Selection With Large Model Space," Biometrika, 95, 759-771. [633]
8. Coakley, C. W., and Hettmansperger, T. P. (1993), "A Bounded Influence, High Breakdown, Efficient Regression Estimator," Journal of the American Statistical Association, 88 (423), 872-880. [627]
9. Donoho, D., and Johnstone, I. (1994), "Ideal Spatial Adaptation via Wavelet Shrinkages," Biometrika, 81, 425-455. [627,633]
10. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," The Annals of Statistics, 32, 407-499. [628]
11. Fan, J., and Lv, J. (2008), "Sure Independence Screening for Ultrahigh Dimensional Feature Space," Journal of the Royal Statistical Society, Ser. B, 70 (5), 849-911. [636]
12. Gannaz, I. (2006), "Robust Estimation and Wavelet Thresholding in Partial Linear Models," technical report, University Joseph Fourier, Grenoble, France. [626,628,629]
13. Gervini, D., and Yohai, V. J. (2002), "A Class of Robust and Fully Efficient Regression Estimators," The Annals of Statistics, 30 (2), 583-616. [633]
14. Hadi, A. S., and Simonoff, J. S. (1993), "Procedures for the Identification of Multiple Outliers in Linear Models," Journal of the American Statistical Association, 88 (424), 1264-1272. [627]
15. Hadi, A. S., and Simonoff, J. S. (1997), "A More Robust Outlier Identifier for Regression Data," Bulletin of the International Statistical Institute, 281-282. [627,633]
16. Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J., and Stahel, W. A. (1986), Robust Statistics: The Approach Based on Influence Functions, New York: Wiley. [626,630,631]
17. Hawkins, D. M., Bradu, D., and Kass, G. V. (1984), "Location of Several Outliers in Multiple-Regression Data Using Elemental Sets," Technometrics, 26 (3), 197-208. [627]
18. Huber, P. J. (1981), Robust Statistics, New York: Wiley. [627,629,630,638]
19. Maronna, R. A., Martin, D. R., and Yohai, V. J. (2006), Robust Statistics: Theory and Methods, Chichester: Wiley. [627,633]
20. McCann, L., andWelsch, R. E. (2007), "Robust Variable Selection Using Least Angle Regression and Elemental Set Sampling," Computational Statistics & Data Analysis, 52 (1), 249-257. [626,628]
21. Menjoge, R. S., and Welsch, R. E. (2010), "A Diagnostic Method for Simultaneous Feature Selection and Outlier Identification in Linear Regression," Computational Statistics & Data Analysis, 54, 3181-3193. [627]
22. Nguyen, T., and Welsch, R. (2010), "Outlier Detection and Least Trimmed Squares Approximation Using Semi-Definite Programming," Computational Statistics & Data Analysis, 54 (12), 3212-3226. [627]
23. Peña, D., and Yohai, V. J. (1995), "The Detection of Influential Subsets in Linear Regression by Using an Influence Matrix," Journal of the Royal Statistical Society, Ser. B, 57 (1), 145-156. [627,633]
24. Peña, D., and Yohai, V. J. (1999), "A Fast Procedure for Outlier Diagnostics in Large Regression Problems," Journal of the American Statistical Association, 94 (446), 434-445. [627,631,633,637]
25. R Development Core Team (2007), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing. Available at http://www.Rproject.org. ISBN 3-900051-07-0. [633]
26. Rousseeuw, P. J. (1984), "Least Median of Squares Regression," Journal of the American Statistical Association, 79 (388), 871-880. [627]
27. Rousseeuw, P. J., and Leroy, A. M. (1987), Robust Regression and Outlier Detection. Wiley Series in Probability and Mathematical Statistics, NewYork: Wiley. [626-628,633]
28. Rousseeuw, P., and Van Driessen, K. (2002), "Computing LTS Regression for Large Data Sets," Estadistica, 54, 163-190. [637]
29. Rousseeuw, P., and Yohai, V. (1984), "Robust Regression by Means of S- Estimators," in Robust and Nonlinear Time Series Analysis (Heidelberg, 1983). Lecture Notes in Statistics, Vol. 26, New York: Springer, pp. 256-272. [627]
30. Salibian-Barrera, M., and Yohai, V. J. (2006), "A Fast Algorithm for S- Regression Estimates," Journal of Computational and Graphical Statistics, 15, 414-427. [633,637]
31. Serbert, D., Montgomery, D., and Rollier, D. (1998), "A Clustering Algorithm for Identifying Multiple Outliers in Linear Regression," Computational Statistics & Data Analysis, 27, 461-484. [627]
32. She, Y. (2009), "Thresholding-Based Iterative Selection Procedures for Model Selection and Shrinkage," Electronic Journal of Statistics, 3, 384-415. [629, 631,636,637]
33. Šidák, Z. (1967), "Rectangular Confidence Regions for the Means of Multivariate Normal Distribution," Journal of the American Statistical Association, 62, 626-633. [628]
34. Simpson, D. G., Ruppert, D., and Carroll, R. J. (1992), "On One-Step GM Estimates and Stability of Inferences in Linear Regression," Journal of the American Statistical Association, 87 (418), 439-450. [627]
35. Theil, H. (1965), "The Analysis of Disturbances in Regression Analysis," Journal of the American Statistical Association, 60 (312), 1067-1079. [631]
36. Weisberg, S. (1985), Applied Linear Regression (2nd ed.), New York: Wiley. [626]
37. Wilcox, R. R. (2005), Introduction to Robust Estimation and Hypothesis Testing (2nd ed.), San Diego, CA: Academic Press. [633]
38. Wisnowski, J. W., Montgomery, D. C., and Simpson, J. R. (2001), "A Comparative Analysis of Multiple Outlier Detection Procedures in the Linear Regression Model," Computational Statistics & Data Analysis, 36 (3), 351-382. [626]
39. Yohai, V. J. (1987), "High Breakdown-Point and High Efficiency Robust Estimates for Regression," The Annals of Statistics, 15 (2), 642-656. [627,633]
40. Zhang, C.-H., and Huang, J. (2008), "The Sparsity and Bias of the Lasso Selection in High-Dimensional Linear Regression," The Annals of Statistics, 36, 1567-1594. [637]
41. Zhao, P., and Yu, B. (2006), "On Model Selection Consistency of Lasso," Journal of Machine Learning Research, 7, 2541-2563. [637]
42. Zou, H., and Hastie, T. (2005), "Regularization and Variable Selection via the Elastic Net," Journal of the Royal Statistical Society, Ser. B, 67 (2), 301-320. [636]