Detecting groups of influential observations in linear regression using survey data-adapting the forward search method

Pakistan Journal of Statistics

Volumn 27, Issue 4, 2011, Pages 507-528

  Li, Jianzhu ^a   Valliant, Richard ^b  

^a University of Michigan ^*  (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Cook's distance; Diagnostics for survey data; Influence; Linear regression; Outliers; Survey data

Indexed keywords

EID: 82055185135     PISSN: 10129367     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (41)

1. Atkinson, A.C. and Riani, M. (2000). Robust Diagnostic Regression Analysis. New York: Springer-Verlag.
2. Atkinson, A.C. and Riani, M. (2004). The forward search and data visualization. Computational Statistics, 19, 29-54.
3. Belsley, D.A., Kuh, E. and Welsch, R. (1980). Regression Diagnostics: Identifying Influential Data and Sources of Collinearity, New York: John Wiley.
4. Binder, D.A. (1983). On the variances of asymptotically normal estimators from complex surveys. International Statistical Review, 51, 279-292.
5. Brewer, K.R.W. (1963). Ratio Estimation and Finite Populations: Some Results Deducible from the Assumption of an Underlying Stochastic Process, Aust. J. Statist., 5(3), 93-105.
6. Brewer, K.R.W. (1979). A Class of Robust Sampling Designs for Large Scale Surveys. J. Amer. Statist. Assoc., 74, 911-915.
7. Brewer, K.R.W. (1994). Survey Sampling Inference: Some Past Perspectives and Present Prospects. Pak. J. Statist., 10(1) A, 213-233.
8. Brewer, K.R.W. (1995). Combining Design-based and Model-based Inference, in Business Survey Methods, eds., Cox, B., Binder, D. Chinappa, B., Christianson, A., Colledge, M. and Kott, P., New York: John Wiley, 589-606.
9. Brewer, K.R.W. (1999). Design-based or Prediction Inference? Stratified Random vs. Stratified Balanced Sampling. International Statistical Review, 67, 35-47.
10. Brewer, K.R.W. and Särndal, C.E. (1983). Six Approaches to Enumerative Survey Sampling, in Incomplete Data in Sample Surveys, vol. 3, eds., Madow, W.G. and Olkin, I. Academic Press, 363-368.
11. Chambers, R.L. (1986). Outlier robust finite population estimation. J. Amer. Statist. Assoc., 81, 1063-1069.
12. Chambers, R.L. and Skinner, C.J. (2003). Analysis of Survey Data. New York: John Wiley.
13. Cook, R.D. (1977). Detection of influential observation in linear regression Technometrics, 19, 15-18.
14. Deville, J. and Särndal, C. (1992). Calibration estimators in survey sampling. J. Amer. Statist. Assoc., 87, 376-382.
15. Duchesne, P. (1999). Robust calibration estimators. Survey Methodology, 25, 43-56.
16. Elliott, M. (2007). Bayesian weight trimming for generalized linear regression models. Survey Methodology, 33, 23-34.
17. Gwet, J. and Rivest, L. (1992). Outlier resistant alternatives to the ratio estimator. J. Amer. Statist. Assoc., 87, 1174-1182.
18. Hulliger, B. (1995). Outlier robust Horvitz-Thompson estimators. Survey Methodology, 21, 79-87.
19. Korn, E.L. and Graubard, B.I. (1999). Analysis of Health Surveys, New York: John Wiley.
20. Li, J. (2007a). Regression Diagnostics for Complex Survey Data: Identification of Influential Observations. Unpublished doctoral dissertation, University of Maryland.
21. Li, J. (2007b). Linear regression diagnostics in cluster samples. Proceedings of the Section on Survey Research Methods, American Statistical Association, 3341-3348. Available at www.amstat.org/sections/SRMS/Proceedings/
22. Li, J. and Valliant, R. (2006). Influence analysis in linear regression with sampling weights. Proceedings of the Section on Survey Research Methods, American Statistical Association, 3330-3337. Available at www.amstat.org/sections/SRMS/Proceedings/
23. Li, J. and Valliant, R. (2009). Survey weighted hat matrix and leverages. Survey Methodology, 35, 15-24.
24. Li, J. and Valliant, R. (2011). Linear Regression Diagnostics for Unclustered Survey Data. Journal of Official Statistics, 27(1). 99-119.
25. Little, R.J.A. (1982). Models for Nonresponse in Sample Surveys. J. Amer. Statist. Assoc., 77, 237-250.
26. Lumley, T. 2008. Survey: analysis of complex survey samples. R package version 3.11. University of Washington: Seattle.
27. Manderscheid, R.W. and Henderson, M.J. (2002). Mental Health, United States, 2002. DHHS Publication No. SMA04-3938. Rockville MD USA: Substance Abuse and Mental Health Services Administration. Available at http://mentalhealth.samhsa.gov/publications/allpubs/SMA04-3938/AppendixA.asp.
28. Moreno-Rebollo, J.L. Muñoz-Reyes, A. and Muñoz-Pichardo, J. (1999). Influence diagnostic in survey sampling: conditional bias. Biometrika, 86, 923-928.
29. Potter, F.J. (1990). A study of procedures to identify and trim extreme sampling weights. Proceedings of the Section on Survey Research Methods, American Statistical Association, 225-230.
30. Potter, F.J. (1993). The effect of weight trimming on nonlinear survey estimates. Proceedings of the Section on Survey Research Methods, American Statistical Association, 758-763.
31. R Development Core Team (2005). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, http://www.R-project.org
32. Scrucca, L. (2009). Forward: Forward search. R package version 1.0.3. http://CRAN.R-project.org/package=forward.
33. Rubin, D.B. (1976). Inference and Missing Data. Biometrika, 63, 581-592.
34. Rousseeuw (1984). Least median of squares regression. J. Amer. Statist. Assoc., 79, 871-880.
35. Skinner, C.J., Holt, D. and Smith, T.M.F. (eds.) (1989). Analysis of Complex Surveys, New York: Wiley.
36. Smith, T.M.F. (1987). Influential Observations in Survey Sampling. J. App. Statist., 14, 143-152.
37. Valliant, R., Dorfman, A.H. and Royall, R.M. (2000). Finite Population Sampling and Inference: A Prediction Approach, New York: John Wiley.
38. Venables, W.N. and Ripley, B.D. (2002). Modern Applied Statistics with S. Fourth Edition. New York: Springer.
39. Weisberg, S. (2005), Applied Linear Regression, 3rd edition. New York: John Wiley & Sons.
40. Welsh, A.H. and Ronchetti, E. (1998). Bias-calibrated estimation from sample surveys containing outliers. J. Roy. Statist. Soc., Series B, 60, 413-428.
41. nd edition. New York: Springer-Verlag.