Data Cleaning Basics: Best Practices in Dealing with Extreme Scores

Newborn and Infant Nursing Reviews

Volumn 10, Issue 1, 2010, Pages 37-43

  Osborne, Jason W ^a  

^a NONE

Author keywords

Data cleaning; Extreme scores; Outliers; Parameter estimates

Indexed keywords

EID: 76649124312     PISSN: 15273369     EISSN: None     Source Type: Journal    
DOI: 10.1053/j.nainr.2009.12.009     Document Type: Article

References (29)

1. Osborne J.W. Sweating the small stuff in educational psychology: how effect size and power reporting failed to change from 1969 to 1999, and what that means for the future of changing practices. Educ Psychol 28 (2008) 1-10
2. Zimmerman D.W. A note on the influence of outliers on parametric and nonparametric tests. J Gen Psychol 121 (1994) 391-401
3. Zimmerman D.W. Increasing the power of nonparametric tests by detecting and downweighting outliers. J Exper Educ 64 (1995) 71-78
4. Jarrell M.G. A comparison of two procedures, the Mahalanobis Distance and the Andrews-Pregibon Statistic, for identifying multivariate outliers. Res Sch 1 (1994) 49-58
5. Rasmussen J.L. Evaluating outlier identification tests: Mahalanobis D Squared and Comrey D. Multivariate Behav Res 23 (1988) 189-202
6. Stevens J.P. Outliers and influential data points in regression analysis. Psychol Bull 95 (1984) 334-344
7. Hawkins D.M. Identification of Outliers (1980), Chapman and Hall, New York
8. Dixon W.J. Analysis of extreme values. Ann Math Stat 21 (1950) 488-506
9. Wainer H. Robust statistics: a survey and some prescriptions. J Educ Stat 1 (1976) 285-312
10. Schwager S.J., and Margolin B.H. Detection of multivariate outliers. Ann Stat 10 (1982) 943-954
11. Miller J. Reaction time analysis with outlier exclusion: bias varies with sample size. Q J Exp Psychol 43 (1991) 907-912
12. Van Selst M., and Jolicoeur P. A solution to the effect of sample size on outlier elimination. Q J Exp Psychol 47 (1994) 631-650
13. Newton R.R., and Rudestam K.E. Your Statistical Consultant: Answers to Your Data Analysis Questions (1999), Sage., Thousand Oaks, CA
14. Barnett V., and Lewis T. Outliers in Statistical Data (1994), Wiley, New York
15. Huck S.W., and Sutton C.O. Some comments concerning the use of monotonic transformations to remove the interaction in two-factor ANOVA's. Educ Psychol Meas 35 (1975) 789-791
16. Osborne JW, Blanchard MR. Random responding from students is a threat to the validity of educational research results. Educational Psychology. in press.
17. Brewer C.S., Nauenberg E., and Osborne J.W. Differences among hospital and non-hospital RNs participation, satisfacton, and organizational committment in western New York. Paper presented at: National meeting of the Association for Health Service Research; June, 1998; Washington DC (1998)
18. Iglewicz B., and Hoaglin D.C. How to Detect and Handle Outliers (1993), ASQC Quality Press, Wilwaukee, WI
19. Osborne J.W. Notes on the use of data transformations. Practical assessment, research, and evaluation (2002) 8. Available online at http://ericae.net/pare/getvn.asp?v=8&n=6
20. Evans V.P. Strategies for detecting outliers in regression analysis: an introductory primer. In: Thompson B. (Ed). Advances in Social Science Methodology Vol. 5 (1999), JAI Press., Stamford, CT 213-233
21. Sachs L. Applied Statistics: A Handbook of Techniques. 2nd ed (1982), Springer-Verlag, New York
22. Rowland-Jones S., Sutton J., Ariyoshi K., et al. HIV-specific cytotoxic T-cells in HIV-exposed but uninfected Gambian women. Nat Med 1 (1995) 59-64
23. Judd C.M., and McClelland GH. Data analysis: A Model Comparison Approach (1989), Harcourt Brace Jovanovich, San Diego, CA
24. Osborne J.W., and Overbay A. The power of outliers (and why researchers should ALWAYS check for them). Practical Assessment, Research, and Evaluation (2004) 9
25. Anscome F.J. Rejection of outliers. Technometrics 2 (1960) 123-147
26. Rousseeuw P., and Leroy A. Robust Regression and Outlier Detection (1987), Wiley, New york
27. Lane K. What Is Robust Regression and How Do You Do It?. Annual meeting of the southwest educational research association. Austin, TX (2002)
28. Zimmerman D.W. Invalidation of parametric and nonparamteric statistical tests by concurrent violation of two assumptions. J Exp Educ 67 (1998) 55-68
29. Cole J.C. How to deal with missing data. In: Osborne J.W. (Ed). Best Practices in Quantitative Methods (2008), Sage Publishing, Thousand Oaks, CA