To adjust or not adjust: Nonparametric effect sizes, confidence intervals, and real-world meaning

Psychology of Sport and Exercise

Volumn 14, Issue 1, 2013, Pages 97-102

  Ivarsson, Andreas ^a   Andersen, Mark B ^b   Johnson, Urban ^a   Lindwall, Magnus ^c  

^a HALMSTAD UNIVERSITY   (Sweden)

^b VICTORIA UNIVERSITY   (Australia)

^c UNIVERSITY OF GOTHENBURG   (Sweden)

Author keywords

Adjusted effect size; Practical significance; Statistical interpretation

Indexed keywords

EID: 84866775756     PISSN: 14690292     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.psychsport.2012.07.007     Document Type: Review

References (42)

1. American Psychological Association Publication manual of the American Psychological Association 2010, Author, Washington, DC. 6th ed.
2. Andersen M.B., McCullagh P., Wilson G. But what do the numbers really tell us? Arbitrary metrics and effect size reporting in sport psychology research. Journal of Sport & Exercise Psychology 2007, 29:664-672.
3. Andersen M.B., Stoové M.A. The sanctity of p < .05 obfuscates good stuff: a comment on Kerr and Goss. Journal of Applied Sport Psychology 1998, 10:168-173. org/10.1080/10413209808406384.
4. Bishara A.J., Hittner J.B. Testing the significance of a correlation with nonnormal data: comparison of Pearson, Spearman, transformation, and resampling approaches. Psychological Methods 2012, Advance online publication. 10.1037/a0028087.
5. Bonett D.G. Transforming odds ratios into correlations for meta-analytic research. American Psychologist 2007, 62:254-255.
6. Claudy J.G. Multiple regression and validity estimation in one sample. Applied Psychological Measurement 1978, 2:595-607. 10.1177/014662167800200414.
7. Cohen J. Statistical power analysis for the behavioral sciences 1988, Erlbaum, Hillsdale, NJ. 2nd ed.
8. Cohen J. A power primer. Psychological Bulletin 1992, 112:155-159. 10.1037/0033-2909.112.1.155.
9. Dunlap W.P. Generalizing the common language effect size indicator to bivariate normal correlations. Psychological Bulletin 1994, 116:509-511. 10.1037/0033-2909.116.3.509.
10. Edvardsson A., Ivarsson A., Johnson U. Is a cognitive-behavioural biofeedback intervention useful to reduce injury risk in junior football players?. Journal of Sport Science and Medicine 2012, 11:331-338.
11. Ezekiel M. The sampling variability of linear and curvilinear regressions: a first approximation to the reliability of the results secured by the graphic "successive approximation" method. The Annals of Mathematical Statistics 1930, 1. 275-315, 317-333. 10.1214/aoms/1177733062.
12. Ferguson C.J. An effect size primer: a guide for clinicians and researchers. Professional Psychology: Research and Practice 2009, 40:532-538. 10.1037/a0015808.
13. Finch S., Cumming G. Putting research in context: understanding confidence intervals from one or more studies. Journal of Pediatric Psychology 2009, 34:903-916. 10.1093/jpepsy/jsn118.
14. Fritz C.O., Morris P.E., Richler J.J. Effect size estimates: current use, calculations, and interpretation. Journal of Experimental Psychology 2012, 141:2-18. 10.1037/a0024338.
15. Fröhlich M., Emrich E., Pieter A., Stark R. Outcome effects and effect sizes in sport sciences. International Journal of Sports Science and Engineering 2009, 3:175-179.
16. Grissom J.R. Probability of superior outcome of one treatment over another. Journal of Applied Psychology 1994, 79:314-316. 10.1037/0021-9010.79.2.314.
17. Grissom R.J., Kim J.J. Effect sizes for research: Univariate and multivariate applications 2012, Taylor & Francis, New York, NY.
18. Hedges L.V., Olkin I. Vote-counting methods in research synthesis. Psychological Bulletin 1980, 88:359-369. 10.1037/0033-2909.88.2.359.
19. Henson R.K. Effect-size measures and meta-analytic thinking in counseling psychology research. The Counseling Psychologist 2006, 34:601-629. 10.1177/0011000005283558.
20. Iaffaldano M., Muchinsky P.M. Job satisfaction and job performance: a meta analysis. Psychological Bulletin 1985, 97:251-273.
21. Jacobson N.S., Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology 1991, 59:12-19. 10.1177/00343552060500010501.
22. Keef S.P., Roberts L.A. The meta-analysis of partial effect sizes. British Journal of Mathematical and Statistical Psychology 2004, 57:97-129. 10.1348/000711004849303.
23. Kirk R. Practical significance: a concept whose time has come. Educational and Psychological Measurement 1996, 56:746-759. 10.1177/0013164496056005002.
24. Kraemer H.C., Morgan G.A., Leech N.L., Gliner J.A., Vaske J.J., Harmon R.J. Measures of clinical significance. Journal of the American Academy of Child and Adolescent Psychiatry 2003, 42:1524-1529. 10.1097/01.chi.0000091507.46853.d1.
25. 2 effects in published regression research. Multiple Linear Regression Viewpoints 2007, 33:1-11.
26. McGraw K.O., Wong S.P. A common language effect size statistic. Psychological Bulletin 1992, 111:361-365. 10.1037/0033-2909.111.2.361.
27. Nakagawa S., Cuthill I.C. Effect size, confidence interval and statistical significance: a practical guide for biologists. Biological Reviews 2007, 82:591-605. 10.1111/j.1469-185X.2007.00027.x.
28. Nuovo J., Melnikow J., Chang D. Reporting number needed to treat and absolute risk reduction in randomized controlled trails. Journal of the American Medical Association 2002, 287:2813-2814. 10.1001/jama.287.21.2813.
29. Pearson K. Mathematical contributions to the theory of evolution. VII. On the correlation of characters not quantitatively measurable. Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of Mathematical or Physical Character 1900, 195:1-47.
30. Roberts K.J., Henson R.K. Correction for bias in estimating effect sizes. Educational and Psychological Measurement 2002, 62:241-252. 10.1177/0013164402062062002003.
31. Rosenthal R. Meta-analytic procedures for social research 1991, Sage, Newbury Park, CA.
32. equvalent: a simple effect size indicator. Psychological Methods 2003, 8:492-496. 10.1037/1082-989X.8.4.492.
33. Rupinski M.T., Dunlap W.P. Approximating Pearson product-moment correlations from Kendall's tau and Spearman's rho. Educational and Psychological Measurement 1996, 46:419-429. 10.1177/0013164496056003004.
34. Ruscio J. A probability-based measure of effect size: robustness to base rates and other factors. Psychological Methods 2008, 13:19-30. 10.1037/1082-989X.13.1.19.
35. Tabachnick B.G., Fidell L.S. Using multivariate statistics 2007, Pearson Education, Inc, Boston. 5th ed.
36. Thomas J.R., Nelson J.K., Silverman S.J. Research methods in physical activity 2005, Human Kinetics, Champaign, IL.
37. Thompson B. "Statistical", "practical", and "clinical": how many kinds of significance do counselors need to consider?. Journal of Counseling and Development 2002, 80:64-71. 10.1002/j.1556-6678.2002.tb00167.x.
38. Thompson B. What future quantitative social science research could look like: confidence intervals for effect sizes. Educational Researcher 2002, 31:25-32. 10.3102/0013189X031003025.
39. Thompson B. Foundations of behavioral statistics: An insight-based approach 2006, Guilford Press, New York, NY.
40. Vacha-Haase T., Thompson B. How to estimate and interpret various effect sizes. Journal of Counseling Psychology 2004, 51:473-481. 10.1037/0022-0167.51.4.473.
41. 2 biased, and if so, what is the best correction formula?. Journal of Experimental Education 2007, 75:109-125. 10.3200/JEXE.75.2.109-125.
42. Wilkinson L. Statistical methods in psychology journals: guidelines and explanations. American Psychologist 1999, 54:594-604. The Task Force on Statistical Inference. 10.1037/0003-066X.54.8.594.