Robust Statistical Estimation

The Oxford Handbook of Quantitative Methods: Volume 1: Foundations

Volumn 1, Issue , 2013, Pages 388-406

  Erceg Hurn, David M ^a   Wilcox, Rand R ^b   Keselman, Harvey J ^c  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c UNIVERSITY OF MANITOBA   (Canada)

Author keywords

bootstrapping; central limit theorem; normality; outliers; parametric; robust estimation; Robustness; software; statistical assumptions

Indexed keywords

EID: 85089007064     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/oxfordhb/9780199934874.013.0019     Document Type: Chapter

References (92)

1. Akritas, M. G., Arnold, S. F., and Brunner, E. (1997). Non para-metric hypotheses and rank statistics for unbalanced factorial designs. Journal of the American Statistical Association, 92, 258-265.
2. Algina, J., Keselman, H. J., and Penfield, R. D. (2005a). An alternative to Cohen’s standardized mean difference effect size: A robust parameter and confidence interval in the two independent groups case. Psychological Methods, 10, 317-328.
3. Algina, J., Keselman, H. J., and Penfield, R. D. (2005b). Effect sizes and their intervals: The two-level repeated measures case. Educational and Psychological Measurement, 65, 241-258. doi: 10.1177/0013164404268675
4. Algina, J., Keselman, H. J., and Penfield, R. D. (2006a). Confidence interval coverage for Cohen’s effect size statistic. Educational and Psychological Measurement, 66, 945-960. doi: 10.1177/0013164406288161
5. Algina, J., Keselman, H. J., and Penfield, R. D. (2006b). Confidence intervals for an effect size when variances are not equal. Journal of Modern Applied Statistical Methods, 5, 2-13.
6. Bentler, P. M., Satorra, A., and Yuan, K. H. (2009). Smoking and cancers: Case-robust analysis of a classic data set. Structural Equation Modeling, 16, 382-390.
7. Blair, R. C., and Higgins, J. J. (1980). A comparison of the power of Wilcoxon’s rank-sum statistics to that of Student’s t statistic under various non normal distributions. Journal of Educational Statistics, 5, 309-335.
8. Blair, R. C., and Higgins, J. J. (1985). Comparison of the power of the paired samples t test to that of Wilcoxon’s signed-ranks test under various population shapes. Psychological Bulletin, 97, 119-128.
9. Bradley, J. V. (1977). A common situation conductive to bizarre distribution shapes. The American Statistician, 31, 147-150.
10. Bradley, J.V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31, 144-152.
11. Bradley, J. V. (1980). Nonrobustness in Z, t, and F tests at large sample sizes. Bulletin of the Psychonomic Society, 16, 333-336.
12. Brunner, E., Domhof, S., and Langer, F. (2002). Nonparametric analysis of longitudinal data in factorial experiments. New York: Wiley.
13. Chernick, M. (1999). Bootstrap methods: A practitioner’s guide. New York: Wiley.
14. Christmann, A., and Van Aelst, S. (2006). Robust estimation of Cronbach’s alpha. Journal of Multivariate Analysis, 97, 1660—1674. doi: 10.1016/j.jmva.2005.05.012
15. Cliff, N. (1996). Ordinal methods for behavioral data analysis. Mahwah, NJ: Hobart Press.
16. Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A., et al. (2007). Statistical reform in psychology: Is anything changing? Psychological Science, 18, 230-232.
17. Efron, B. (1979). Bootstrap methods: Another look at the jackknife. The Annals of Statistics, 7, 1-26.
18. Erceg-Hurn, D., and Mirosevich, V. M. (2008). Modern robust statistical methods: An easy way to maximize the power and accuracy of your research. American Psychologist, 63, 591-601.
19. Erceg-Hurn, D., and Steed, L. G. (2011). Graphic cigarette warnings and psychological reactance. Journal of Applied Social Psychology, 41, 219—237.
20. Field, A. (2009). Discovering statistics using SPSS (3rd ed.). London: Sage Publications.
21. Gartside, P. (2001). Letters to the editor. The American Statistican, 55, 171-174.
22. Geary, R. C. (1947). Testing for normality. Biometrika, 34, 209242.
23. Glass, G. V., and Hopkins, K. D. (1996). Statistical methods in education and psychology (3rd ed.). Boston: Allyn and Bacon.
24. Grenard, J. L., Ames, S. L., Wiers, R. W, Thush, C., Suss-man, S., and Stacy, A. W (2008). Working memory capacity moderates the predictive effects of drug-related associations on substance use. Psychology of Addictive Behaviors, 22, 426-432.
25. Grissom, R. J. (2000). Heterogeneity of variance in clinical data. Journal of Consulting and Clinical Psychology, 68, 155-165.
26. Guthrie, A. (2001). Using bootstrap methods with popular statistics programs. Paper presented at the Annual Meeting of the Southwest Educational Research Association, New Orleans, LA. Retrieved www.eric.ed.gov/ERICWebPortal/recordDetail?accno=ED450149. Accessed July 5, 2012.
27. Hampel, F. (1968). Contributions to the theory of robust estimation. University of California, Berkley.
28. Hampel, F. R. (1985). The breakdown points of the mean combined with some rejection rules. Technometrics, 27, 95-107.
29. Harwell, M. R., Rubinstein, E. N., Hayes, W S., and Olds, C. C. (1992). Summarizing monte carlo results in methodological research: The one- and two-factor fixed effects anova cases. Journal of Educational Statistics, 17, 315-339.
30. Hettmansperger, T. P. (1998). The goals and strategies of robust methods: Comments. British Journal of Mathematical and Statistical Psychology, 51, 41.
31. Hettmansperger, T. P., and McKean, J. W (1998). Robust non parametric statistical methods. London: Arnold Publishing.
32. Hill, M., and Dixon, W. J. (1982). Robustness in real life: A study of clinical laboratory data. Biometrics, 38, 377-396.
33. Ho, K. P., Hunt, C., and Li, S. (2008). Patterns of help-seeking behavior for anxiety disorders among the chinese speaking australian community Social Psychiatry and Psychiatric Epidemiology, 43, 872-877. doi: 10.1007/s00127-008-0387-0
34. Howell, D. (2008). Fundamentals of statistics for the behavioral sciences. Belmont, CA: Thomson-Wadsworth.
35. Huber, P. (1964). Robust estimation of a location parameter. Annals of Mathematical Statistics, 35, 73-101.
36. Huber, P., and Ronchetti, E. (2009). Robust statistics. New Jersey: John Wiley and Sons.
37. Keselman, H. J., Algina, J., Lix, L. M., Wilcox, R. R., and Deering, K. (2008). A generally robust approach for testing hypotheses and setting confidence intervals for effect sizes. Psychological Methods, 13, 110-129.
38. Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., et al. (1998). Statistical practices of educational researchers: An analysis of their anova, manova, and ancova analyses. Review of Educational Research, 68, 350386.
39. Keselman, H. J., Othman, A. R., Wilcox, R. R., and Fradette, K. (2004). The new and improved two-sample t test. Psychological Science, 15, 47-51. doi: 10.1111/j.0963-7214.2004.01501008.x
40. Keselman, H. J., Wilcox, R. R., Algina, J., Othman, A. R., and Fradette, K. (2008). A comparative study of robust tests for spread: Asymmetric trimming strategies. British Journal of Mathematical and Statistical Psychology, 61, 235-253.
41. Keselman, H. J., Wilcox, R. R., Lix, L. M., Algina, J., and Fradette, K. (2007). Adaptive robust estimation and testing. British Journal of Mathematical and Statistical Psychology, 60, 267-293.
42. Kornbrot, D. E. (1998). The goals and strategies of robust methods: Comment. British Journal of Mathematical and Statistical Psychology, 51, 43.
43. Lim, S., and Melville, N. P. (2009). Robustness of structural equation modeling to distributional misspecification: Empirical evidence and research guidelines. Retrieved from http://ssrn.Com/abstract=1375251
44. Liu, Y., and Zumbo, B. D. (2007). The impact of outliers on cron-bach’s coefficient alpha estimate of reliability: Visual analogue scales. Educational and Psychological Measurement, 67, 620-634. doi: 10.1177/0013164406296976. Accessed July 5, 2012.
45. Lix, L. M., and Keselman, H. J. (1998). To trim or not to trim: Tests of location equality under heteroscedasticity and nonnormality. Educational and Psychological Measurement, 58, 409-429.
46. Lix, L. M., Keselman, J. C., and Keselman, H. J. (1996). Consequences of assumption violations revisited: A quantitative review of alternatives to the one-way analysis of variance “F” test. Review of Educational Research, 66, 579-619.
47. Lunnenborg, C. (2000). Data analysis by resampling: Concepts and applications. Pacific Grove, CA: Duxbury.
48. MacDonald, P. (1999). Power, Type I, and Type III error rates of parametric and nonparametric statistical tests. Journal of Experimental Education, 67, 367-379.
49. Maronna, R., Martin, R., and Yohal, V. (2006). Robust statistics theory and methods. West Sussex, UK: John Wiley.
50. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
51. Nester, M. (1996). An applied statistician’s creed. Applied Statistics, 45, 401-410.
52. Osborne, J. (2002). Notes on the use of data transformations. Practical Assessment, Research and Evaluation, 8, Retrieved from http://pareonline.net/getvn.asp?v=8andn=6. Accessed July 5, 2012.
53. Pison, G., Rousseeuw, P. J., Filzmoser, P., and Croux, C. (2003). Robust factor analysis. Journal of Multivariate Analysis, 84, 145-172.
54. Ramsey, P. H. (1980). Exact type I error rates for robustness of Student’s t test with unequal variances. Journal of Educational Statistics, 5, 337-349.
55. Rodgers, J. (1999). The bootstrap, the jacknife, and the randomization test: A sampling taxonomy. Multivariate Behavioral Research, 34, 441-456.
56. Rousseeuw, P. (1990). Robust estimation and identifying outliers. In H. M. Wadsworth (Ed.), Handbook of statistical methods for engineers and scientists (pp. 16.11-16.24.). New York: McGraw-Hill.
57. Rousseeuw, P., and Leroy, P. (2003). Robust regression and outlier detection. New Jersey: John Wiley.
58. Sawilowsky, S. S. (1990). Nonparametric tests of interaction in experimental design. Review of Educational Research, 60, 91126.
59. Sawilowsky, S. S. (1998). The goals and strategies of robust methods: Comment. British Journal of Mathematical and Statistical Psychology, 51, 49.
60. Sawilowsky, S. S., and Blair, R. C. (1992). A more realistic look at the robustness and type II error properties of the t test to departures from population normality. Psychological Bulletin, 111, 352-360.
61. Schug, R. A., Raine, A., and Wilcox, R. R. (2007). Psychophysiological and behavioural characteristics of individuals comorbid for antisocial personality disorder and schizophrenia-spectrum personality disorder. British Journal of Psychiatry, 191, 408-414.
62. Serlin, R. C., and Harwell, M. R. (2004). More powerful tests of predictor subsets in regression analysis under nonnormality. Psychological Methods, 9, 492-509.
63. Smith, Z., and Wells, C. (October 18-20, 2006). Central limit theorem and sample size. Paper presented at the Northeastern Educational Research Association, Kerkonkson, New York. Retrieved from http://www.umass.edu/remp/Papers/Smithand Wells_NERA06.pdf.
64. Stromberg, A. (2004). Why write statistical software? The case of robust statistical methods. Journal of Statistical Software, 10, Retrieved from http://www.jstatsoft.org/v10/i05/.
65. Tukey, J. (1962). The future of data analysis. Annals of Mathematical Statistics, 33, 1-67.
66. Tukey, J. (1979). Robust techniques for the user. In R. L. Launer and G. N. Wilkinson (Eds.), Robustness in statistics (pp. 103-106). New York: Academic Press.
67. Wells, C., and Hintze, J. (2007). Dealing with assumptions underlying statistical tests. Psychology in the Schools, 44, 495-502.
68. Wilcox, R. R. (1998a). The goals and strategies of robust methods. British Journal of Mathematical and Statistical Psychology, 51, 1-39.
69. Wilcox, R. R. (1998b). How many discoveries have been lost by ignoring modern statistical methods? American Psychologist, 53, 300-314.
70. Wilcox, R. R. (2003). Applying contemporary statistical techniques. San Diego, CA: Academic Press.
71. Wilcox, R. R. (2008). Robust principal components: A generalized variance perspective. Behavior Research Methods, 40, 102-108.
72. Wilcox, R. R. (2010). Fundamentals of modern statistical methods (2nd ed.). New York: Springer.
73. Wilcox, R. R. (2012a). Introduction to robust estimation and hypothesis testing (3rd ed.). San Diego, CA: Elsevier.
74. Wilcox, R. R. (2012b). Modern statistics for the social and behavioral sciences: A practical introductions. New York: Chapman and Hall.
75. Wilcox, R. R., Charlin, V. L., and Thompson, K. L. (1986). New monte carlo results on the robustness of the anova F, W and F* statistics. Communications in Statistics—Simulation and Computation, 15, 933-943.
76. Wilcox, R. R., and Erceg-Hurn, D. M. (2012). Comparing two independent groups via the lower and upper quantiles. Manuscript under review.
77. Wilcox, R. R., and Erceg-Hurn, D. M. (2012). Comparing two dependent groups via quantiles. Manuscript under review.
78. Wilcox, R. R., and Keselman, H. J. (2003). Modern robust data analysis methods: Measures of central tendency. Psychological Methods, 8, 254-274.
79. Wilcox, R. R., and Tian, T. (in press). Measuring effect size: A robust heteroscedastic approach for two or more groups. Journal of Applied Statistics.
80. Wu, P.-C. (2002). The central limit theorem and comparing means, trimmed means, one step m-estimators and modified one step m-estimators under non-normality. University of Southern California.
81. Yuan, K. H., and Bentler, P. M. (1998). Robust mean and covariance structure analysis. British Journal of Mathematical and Statistical Psychology, 51, 63.
82. Yuan, K. H., and Bentler, P. M. (2000). Robust mean and covariance structure analysis through iteratively reweighted least squares. Psychometrika, 65, 43-58. doi: 10.1007/BF02294185
83. Yuan, K. H., and Bentler, P. M. (2001). Effect of outliers on estimators and tests in covariance structure analysis. British Journal of Mathematical and Statistical Psychology, 54, 161175.
84. Yuan, K. H., and Bentler, P. M. (2007). Robust procedures for structural equation modeling. In S.-Y. Lee (Ed.), Handbook of latent variable and related methods (pp. 367-398). New York: Elsevier.
85. Yuan, K. H., Bentler, P. M., and Chan, W. (2004). Structural equation modeling with heavy tailed distributions. Psychometrika, 69, 421—436. doi: 10.1007/BF02295644
86. Yuan, K. H., Bentler, P. M., and Zhang, W. (2005). The effect of skewness and kurtosis on mean and covariance structure analysis: The univariate case and its multivariate implication. Sociological Methods Research, 34, 240-258. doi: 10.1177/0049124105280200
87. Yuan, K. H., Marshall, L. M., and Bentler, P. M. (2002). A unified approach to exploratory factor analysis with missing data, nonnormal data, and in the presence of outliers. Psychomernka, 67, 95-121. doi: 10.1007/BF02294711
88. Yuan, K. H., Marshall, L. M., and Weston, R. (2002). Cross validation by down weighting influential cases in structural equation modelling. British Journal of Mathematical and Statistical Psychology, 55, 125-143.
89. Yuen, K. (1974). The two-sample trimmed t for unequal population variances. Biometrika, 61, 165-170.
90. Zimmerman, D. W. (1998). Invalidation of parametric and non-parametric statistical tests by concurrent violation of two assumptions. Journal of Experimental Education, 67, 55-68.
91. Zimmerman, D. W (2000). Statistical significance levels of nonparametric tests biased by heterogeneous variances of treatment groups. Journal of General Psychology, 127, 354-364.
92. Zu, J., and Yuan, K. H. (2010). Local influence and robust procedures for mediation analysis. Multivariate Behavioral Research, 45, 1-44.