A critique and improvement of the CL common language effect size statistics of McGraw and Wong

Journal of Educational and Behavioral Statistics

Volumn 25, Issue 2, 2000, Pages 101-132

  Vargha, András ^a   Delaney, Harold D ^b  

^a EÖTVÖS LORÁND UNIVERSITY   (Hungary)

^b UNIVERSITY OF NEW MEXICO   (United States)

Author keywords

Effect size measures; Friedman test; Group comparison; Kruskal Wallis test; Mann Whitney Wilcoxon test; Measure of stochastic superiority; Sign test; Stochastic equality; Stochastic homogeneity

Indexed keywords

EID: 0034411339     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986025002101     Document Type: Article

References (35)

1. Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509.
2. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (Rev. ed.). New York: Academic Press.
3. Fligner, M. A. (1985). Pairwise versus joint ranking: Another look at the Kruskal-Wallis statistic. Biometrika, 72, 705-709.
4. Fligner, M. A., & Policello, II, G. E. (1981). Robust rank procedures for the Behrens-Fisher problem. Journal of the American Statistical Association, 76, 323-327.
5. Friedman, H. (1968). Magnitude of experimental effect and a table of its rapid estimation. Psychological Bulletin, 70, 245-251.
6. Gibbons, J. D. & Chakraborti, S. (1992). Nonparametric statistical inference (3rd ed.). New York: Marcel Dekker.
7. Hájek, J. (1969). A course in nonparametric statistics. San Francisco: Holden-Day.
8. Hettmansperger, T. P. (1984). Statistical inference based on ranks. New York: Wiley.
9. Hollander, M., & Wolfe, D. A. (1973). Nonparametric statistical methods. New York: Wiley.
10. Kendall, M. G., & Stuart, A. (1973). The advanced theory of statistics, Vol. 2: Inference and relationship (3rd ed.). London: Griffin.
11. Kruskal, W. H. (1952). A nonparametric test for the several sample problem. The Annals of Mathematical Statistics, 23, 525-540.
12. Lehmann, E. L. (1975). Nonparametrics: Statistical methods based on ranks. San Franciso: Holden-Day.
13. Levy, P. (1967). Substantive significance of significant differences between groups. Psychological Bulletin, 67, 37-40.
14. Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics, 18, 50-60.
15. Maritz, J. S. (1995). Distribution-free statistical methods (2nd ed.). London, New York, Tokyo: Chapman & Hall.
16. Maxwell, S. E., & Delaney, H. D. (2000). Designing experiments and analyzing data. A model comparison perspective (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
17. McGraw, K. O., & Wong, S. P. (1992). A common language effect size statistic. Psychological Bulletin, 111, 361-365.
18. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
19. Miller, J. (1988). A warning about median reaction time. Journal of Experimental Psychology: Human Perception and Performance, 14, 539-543.
20. Miller, R. G. (1986). Beyond ANOVA. Basics of applied statistics. New York: Wiley.
21. Noether, G. E. (1967). Elements of nonparametric statistics. New York: Wiley.
22. Onghena, P. (1993). A theoretical and empirical comparison of mainframe, microcomputer, and pocket calculator pseudorandom number generators. Behavior Research Methods, Instruments, & Computers, 25, 384-395.
23. Ramberg, J. S., Tadikamalla, P. R., Dudewicz, E. J., & Mykytka, E. F. (1979). A probability distribution and its uses in fitting data. Technometrics, 21, 201-209.
24. Randles, R. H., & Wolfe, D. A. (1979). Introduction to the theory of nonparametric statistics. New York: Wiley.
25. Rosenthal, R., & Rubin, D. B. (1982). A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169.
26. Vargha, A. (1989). A Magyar Rorschach Standard táblázatai. [The tables of the Hungarian Rorschach Standard.] Budapest: Schoolbook Publisher.
27. Vargha, A. (1999). MiniStat 3.1 verzió. Felhasználói kézikönyv. [MiniStat, Version 3.1. Manual] Budapest: Pólya Kiadó.
28. Vargha, A., & Delaney, H. D. (1998). The Kruskal-Wallis test and stochastic homogeneity. Journal of Educational and Behavioral Statistics, 23, 170-192.
29. Wilcox, R. R. (1990). Determining whether an experimental group is stochastically larger than a control. British Journal of Mathematical and Statistical Psychology, 43, 327-333.
30. Wilcox, R. R. (1996). Statistics for the social sciences. San Diego, New York: Academic Press.
31. Winer, B. J. (1971). Statistical principles in experimental design (2nd ed.). Tokyo, London: McGraw-Hill Kogakusha.
32. Zimmerman, D. W., & Zumbo, B. D. (1992). Parametric alternatives to the Student t test under violation of normality and homogeneity of variance. Perceptual and Motor Skills, 74, 835-844.
33. Zimmerman, D. W., & Zumbo, B. D. (1993a). Rank transformations and power of the Student t test and Welch t' test for non-normal populations with unequal variances. Canadian Journal of Experimental Psychology, 47, 523-539.
34. Zimmerman, D. W., & Zumbo, B. D. (1993b). The relative power of parametric and nonparametric statistical methods. In: G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 481-517). Hillsdale, NJ: Erlbaum.
35. Zumbo, B. D., & Coulombe, D. (1997). Investigation of the robust rank-order test for non-normal populations with unequal variances: The case of reaction time. Canadian Journal of Experimental Psychology, 51, 139-149.