Confidence Intervals for the Probability of Superiority Effect Size Measure and the Area Under a Receiver Operating Characteristic Curve

Multivariate Behavioral Research

Volumn 47, Issue 2, 2012, Pages 201-223

  Ruscio, John ^a   Mullen, Tara ^a  

^a The College of New Jersey   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84859572049     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2012.658329     Document Type: Article

References (41)

1. American Psychological Association. 2009. Publication manual of the American Psychological Association, 6th ed. Washington, DC: Author.
2. Brown, B. M., Newcombe, R. G. and Zhao, Y. 2009. Non-null semi-parametric inference for the Mann-Whitney measure. Journal of Nonparametric Statistics, 21: 743-755.
3. Brunner, E. and Munzel, U. 2000. The nonparametric Behrens-Fisher problem: Asymptotic theory and small-sample approximation. Biometrical Journal, 42: 17-25.
4. Cliff, N. 1993. Dominance statistics: Ordinal methods for behavioral data analysis. Psychological Bulletin, 114: 494-509.
5. Cliff, N. 1996. Ordinal methods for behavioral data analysis. Mahwah, NJ: Erlbaum.
6. Cohen, J. 1988. Statistical power analysis for the behavioral sciences, 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates.
7. Delaney, H. D. and Vargha, A. 2002. Comparing several robust tests of stochastic equality with ordinally scaled variables and small to moderate sample sizes. Psychological Methods,: 485-503.
8. Efron, B. and Tibshirani, R. J. 1993. An introduction to the bootstrap. San Francisco, CA: Chapman & Hall.
9. Fagerland, M. W. and Sandvik, L. 2009. The Wilcoxon-Mann-Whitney test under scrutiny. Statistics in Medicine, 28: 1487-1497.
10. Fawcett, T. 2006. An introduction to ROC analysis. Pattern Recognition Letters, 27: 861-874.
11. Fligner, M. A. and Policello, G. E. II. 1981. Robust rank procedures for the Behrens-Fisher problem. Journal of the American Statistical Association, 76: 162-168.
12. Glass, G. V. 1976. Primary, secondary, and meta-analysis of research. Educational Researcher,
13. Goldberger, M. L., Maher, B. A. and Flattau, P. E. 1995. Research doctorate programs in the United States: Continuity and change. Washington, DC: National Academies Press.
14. Grissom, R. J. and Kim, J. J. 2001. Review of assumptions and problems in the appropriate conceptualization of effect size. Psychological Methods,: 135-146.
15. Grissom, R. J. and Kim, J. J. 2005. Effect sizes for research: A broad practical approach. Mahwah, NJ: Erlbaum.
16. Hanley, J. A. and McNeil, B. J. 1982. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143: 29-36.
17. Hedges, L. V. 1981. Distributional theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics,: 107-128.
18. Hirsch, J. E. 2005. An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences, 102: 16569-16572.
19. Hoaglin, D. C. 1985. "Summarizing shape numerically: The g-and- distributions.". In Exploring data, tables, trends, and shapes Edited by: Hoaglin, D. C., Mosteller, F. and Tukey, J. W. 461-509. New York, NY: Wiley.
20. Hsu, L. M. 2004. Biases of success rate differences shown in binomial effect size displays. Psychological Methods,: 183-197.
21. Kirk, R. E. 1996. Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56: 746-759.
22. Lee, W.-C. and Rodgers, J. L. 1998. Bootstrapping correlation coefficients using univariate and bivariate sampling. Psychological Methods,: 91-103.
23. McGrath, R. E. and Meyer, G. J. 2006. When effect sizes disagree: The case of r and d. Psychological Methods, 11: 386-401.
24. McGraw, K. O. and Wong, S. P. 1992. A common language effect size statistic. Psychological Bulletin, 111: 361-365.
25. Mee, R. W. 1990. Confidence intervals for probabilities and tolerance regions based on a generalization of the Mann-Whitney statistic. Journal of the American Statistical Association, 85: 793-800.
26. Neuhauser, M., Losch, C. and Jockel, K.-H. 2007. The Chen-Luo test in case of heteroscedasticity. Computational Statistics and Data Analysis, 51: 5055-5060.
27. Newcombe, R. G. 2006a. Confidence intervals for an effect size measure based on the Mann-Whitney statistic: Part 1. General issues and tail-based area methods. Statistics in Medicine, 25: 543-557.
28. Newcombe, R. G. 2006b. Confidence intervals for an effect size measure based on the Mann-Whitney statistic: Part 2. Asymptotic methods and evaluation. Statistics in Medicine, 25: 559-573.
29. R Development Core Team. 2011. R: A language and environment for statistical computing [Software] Retrieved from http://www.R-project.org
30. Rodgers, J. L. 1999. The bootstrap, the jackknife, and the randomization test: A sampling taxonomy. Multivariate Behavioral Research, 34: 441-456.
31. Ruscio, J. 2008. A probability-based measure of effect size: Robustness to base rates and other factors. Psychological Methods, 13: 19-30.
32. Ruscio, J., Seaman, F., D'Oriano, C., Stremlo, E. and Mahalchik, K. 2011. Evaluating scholarly impact: New tools to address old problems. Manuscript submitted for publication
33. Ryu, E. and Agresti, A. 2008. Modeling and inference for an effect size measure. Statistics in Medicine, 27: 1703-1717.
34. Swets, J. A. 1988. Measuring the accuracy of diagnostic systems. Science, 240: 1285-1293.
35. Swets, J. A., Dawes, R. M. and Monahan, J. 2000. Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest,: 26
36. Thompson, B. 2002. What future quantitative social science research could look like: Confidence intervals for effect size. Educational Researcher, 31: 25-32.
37. Vargha, A. and Delaney, H. D. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics, 25: 101-132.
38. Vollandt, R. and Horn, M. 1997. Evaluation of Noether's method of sample size determination for the Wilcoxon-Mann-Whitney test. Biometrical Journal, 39: 823-829.
39. L. Wilkinson, and the APA Task Force on Statistical Inference. 1999. Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54: 594-604.
40. Wolfe, D. A. and Hogg, R. V. 1971. On constructing statistics and reporting data. The American Statistician, 25: 27-30.
41. Zhou, W. 2008. Statistical inference for P(X < Y). Statistics in Medicine, 27: 257-279.