Effect Size and Sample Size Planning

The Oxford Handbook of Quantitative Methods: Volume 1: Foundations

Volumn 1, Issue , 2013, Pages 206-222

  Kelley, Ken ^a  

^a UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

accuracy in parameter estimation; confidence intervals; Effect size; null hypothesis significance test; power analysis; research design; sample size planning; study design

Indexed keywords

EID: 84929511518     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/oxfordhb/9780199934874.013.0011     Document Type: Chapter

References (51)

1. Aberson, C. L. (2010). Applied Power Analysis for the Behavioral Sciences. New York: Psychology Press.
2. American Educational Research Association (2006). Standards for reporting on empirical social science research in AERA publications. Washington, DC: American Educational Research Association.
3. American Psychological Association (2010). Publication manual of the American Psychological Association (6th ed). Washington, DC: American Psychological Association.
4. Baugley, T (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603-617.
5. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-37.
6. Bausell, R. B., and Li, Y-F. (2002). Power analysis in experimental research: A practical guide for the biological, medical, and social sciences. New York: Cambridge.
7. Browne, R. H. (1995). On the use of a pilot sample for sample size determination. Statistics in Medicine, 14, 1933-1940.
8. Chow, S-C., Shao, J., and Wang, H. (2003). Sample size calculations in clinical research. New York: Taylor and Francis.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
10. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
11. Cohen, J. (1994). The world is round (p<.05). American Psychologist, 49, 997-1003.
12. Dattalo, P. (2008). Determining sample size: Balancing power, precision, and practicality. New York: Oxford University Press.
13. Davey, A., and Savla, J. (2010). Statistical power analysis with missing data: A structural equation modeling approach. New York: Routledge.
14. Des Jarlais D.C., Lyles C.M., Crepaz N, and the TREND Group. (2004). Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. American Journal of Public Health, 91, 361-366.
15. Grissom, R. J. and Kim, J. J. (2012). Effect sizes for research: Univariate and multivariate applications (2nd ed.). New York, NY: Routledge.
16. Guenther, W C. (1965). Concepts of statistical inference. New York: McGraw-Hill.
17. Harlow, L. L., Mulaik, S. A., and Steiger, J. H. (1997). What if there were no significance tests? Mahwah, NJ: Erlbaum.
18. Hahn, G. J., and Meeker, W Q. (1991). Statistical intervals: A guide for practitioners. New York, NY: Wiley.
19. Hunter, J. E. and Schmidt, F. L. (2004). Methods of meta analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
20. Jiroutek, M. R., Muller, K. E., Kupper, L. L, and Stewart, P. W (2003). A new method for choosing sample size for confidence-interval based inferences. Biometrics, 59, 580-590.
21. Kelley, K. and Maxwell, S.E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods, 8, 305-321.
22. Rausch, J. R., Maxwell, S.E., and Kelley, K. (2003). Obtaining power or obtaining precision: Delineating methods of sample-size planning. Evaluation and the Health Professions, 26, 258-287.
23. Kelley, K. and Preacher, K. J. (in press). On effect size. Psychological Methods.
24. Kelley, K., and Rausch, J. R. (2006). Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals. Psychological Methods, 11, 363-385.
25. Keppel, G. and Wickens, T.D. (2004). Design and Analysis: A Researcher’s Handbook (4th ed.). Upper Saddle River, NJ: Prentice Hall.
26. Kirk, R.E. (1995). Experimental design: Procedures for behavioral sciences (3rd ed.). Pacific Grove, CA: Brooks/Cole.
27. Kraemer H.C., Gardner C., Brooks J.O., and Yesavage J.A. (1998). Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints. Psychological Methods 3, 23-31.
28. Kraemer H.C. and Thiemann S., (1987). How many subjects? Statistical power analysis in research. Newbury Park, CA: Sage.
29. Lenth, R. V. (2001). Some practical guidelines for effective sample size determination. The American Statistician, 55, 187-193.
30. Lipsey, M. W. (1990). Design sensitivity: Statistical power for experimental research. Newbury Park, CA: Sage.
31. Mace, A. E. (1964). Sample-size determination. New York: Reinhold.
32. Machin, D., Campbell, M. J., Tan, S. B., and Tan, S. H. (2009). Sample size tables for clinical studies (3rd ed.). Hoboken, NJ: Wiley-Blackwell.
33. Maxwell S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods, 9, 147-163.
34. Maxwell, S. E., and Delaney, H. D. (2004). Designing experiments and analyzing data: A model comparison perspective (2nd ed.). Mahwah, NJ: Erlbaum.
35. Maxwell, S. E., Kelley, K., and Rausch, J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537-563.
36. Moher, D., Hopewell, S., Schulz, K., Montori, V., Gøtzsche, P. C., Devereaux, P.J., Elbourne, D., et al. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomized trials, British Medical Journal, 340, 698-702.
37. Morrison, D. E., and Henkel, R. E. (Eds.). (1970). The significance test controversy: A reader. Chicago: Aldine.
38. Murphy, K. R., Myors, B., and Wolach, A. (2008). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests (3rd ed.). Mahwah, NJ: Erlbaum.
39. Muthén, B. O., and Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2, 371-402.
40. Myers, J. L., and Well, A. (2003). Research design and statistical analysis (2nd ed.). Mahwah, NJ: Earlbaum.
41. O'Brien, R.G. and Muller, K.E. (1993). Unified power analysis for t-tests through multivariate hypotheses. In L. K. Edwards (Ed.), Applied analysis of variance in behavioral science (pp. 297-344), New York: Marcel Dekker.
42. Preacher, K. J., and Kelley, K. (2011). Effect size measures for mediation models: Quantitative strategies for communicating indirect effects. Psychological Methods, 16, 93-115.
43. Rausch, J. R., Maxwell, S.E., and Kelley, K. (2003). Obtaining power or obtaining precision: Delineating methods of sample-size planning. Evaluation and the Health Professions, 26, 258-287.
44. Rausch, J. R., Maxwell, S.E., and Kelley, K. (2003). Analytic methods for questions pertaining to a randomized pretest, posttest, follow-up design. Journal of Clinical Child and Adolescent Psychology, 32, 467-486.
45. Revelle, W and Zinbarg, R. E. (2009). Coefficients alpha, beta, omega and the glb: comments on Sijtsma. Psychometrika, 74, 145-154.
46. Shadish W R., Cook T. D., and Campbell D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton-Mifflin.
47. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
48. Thompson, B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25-32.
49. Vickers, A.J. (2003). Under powering in randomized trials reporting a sample size calculation. Journal of Clinical Epidemiology, 56, 717-720.
50. Wilkinson, L., and the Task Force on Statistical lnference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
51. Winer, B. J., Brown, D. R., and Michels, K. M. (1991). Statistical principles in experimental design (3rd ed.). New York: McGraw-Hill.