Obtaining power or obtaining precision: Delineating methods of sample-size planning

Evaluation and the Health Professions

Volumn 26, Issue 3, 2003, Pages 258-287

  Kelley, Ken ^a   Maxwell, Scott E ^a   Rausch, Joseph R ^a  

^a UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

Accuracy in parameter estimation; Experimental design; Sample size planning; Statistical power; Statistical precision

Indexed keywords

ACCURACY; CONFIDENCE INTERVAL; PLANNING; PROBABILITY; REVIEW; SAMPLE SIZE;

ANALYSIS OF VARIANCE; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HEALTH SERVICES RESEARCH; HUMANS; MODELS, STATISTICAL; RESEARCH DESIGN; SAMPLE SIZE; UNITED STATES;

EID: 0043074892     PISSN: 01632787     EISSN: None     Source Type: Journal    
DOI: 10.1177/0163278703255242     Document Type: Review

References (45)

1. Algina, J., & Olejnik, S. (2000). Determining sample size for accurate estimation of the squared multiple correlation coefficient. Multivariate Behavioral Research, 35(1), 119-136.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
3. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
4. Bausell, R. B., & Li, Y. F. (2002). Power analysis for experimental research: A practical guide for the biological, medical and social sciences. New York: Cambridge University Press.
5. Bonett, D. G., & Wright, T. A. (2000). Sample size requirements for estimating Pearson, Kendall and Spearman correlations. Psychometrika, 65(1), 23-28.
6. Casti, J. L. (1990). Searching for certainty: What scientists can known about the future. New York: William Morror.
7. Cobb, E. B. (1984). Planning research studies: An alternative to power analysis. Nursing Research, 34(6), 386-388.
8. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
9. Cohen, J. (1969). Statistical power analysis for the behavioral sciences (1st ed.). New York: Academic Press.
10. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NY: Lawrence Erlbaum.
11. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45(12), 1304-1312.
12. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49(12), 997-1003.
13. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61(4), 532-574.
14. Darlington, R. B. (1990). Regression and linear models. New York: McGraw-Hill.
15. Gardner, M. J., & Altman, D. G. (1986). Confidence intervals rather than P values: Estimation rather than hypothesis testing. British Medical Journal, 292, 746-750.
16. Guenther, W. C. (1981). Sample size formulas for normal theory t-tests, The American Statistician, 35, 243-244.
17. Hagen, R. L. (1997). In praise of the null hypothesis statistical test. American Psychologist, 52(1), 15-24.
18. Hahn, G., & Meeker, W. (1991). Statistical intervals: A guide for practitioners. New York: John Wiley.
19. Hays, W. L. (1994). Statistics (5th ed.) New York: Harcourt Brace College.
20. Hedges, L., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
21. Hellmann, J. J., & Fowler, G. W. (1999). Bias, precision, and accuracy of four measures of species richness. Ecological Applications, 9(3), 824-834.
22. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
23. Kelley, K., & Maxwell, S. E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simple significant. Psychological Methods, 8(3).
24. Kraemer, H. C., Gardner, C., Brooks, J. O., & Yesavage, J. A. (1998). Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints. Psychological Methods, 3, 23-31.
25. Kraemer, H. C., & Thiemann, S. (1987). How many subjects? Beverly Hills, CA: Sage.
26. Lenth, R. V. (2001). Some practical guidelines for effective sample size determination. The American Statistician, 55, 187-193.
27. Lipsey, M. (1990). Design sensitivity: Statistical power for experimental research. Newbury Park, CA: Sage.
28. Maxwell, S. E. (2000). Sample size and multiple regression analysis. Psychological Methods, 5(4), 434-458.
29. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress in soft psychology. Journal of Counseling and Clinical Psychology, 46(4), 806-834.
30. Murphy, K. (2002). Using power analysis to evaluate and improve research. In S. G. Rogelberg (Ed.), Handbook of research in industrial and organizational psychology (pp. 119-137). Malden, MA: Blackwell.
31. Murphy, K. R., & Myors, B. (1998). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests. Mahwah, NJ: Lawrence Erlbaum.
32. Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775-777.
33. Rosenthal, R. (1993). Cumulative evidence. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 519-559). Hillsdale, NJ: Lawrence Erlbaum.
34. Ross, S. (2002). A first course in probability (6th ed.). Upper Saddle River, NJ: Prentice Hall.
35. Rossi, J. S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58(5), 646-656.
36. Rozeboom, W. W. (1966). Foundations of the theory of prediction. Homewood, IL: Dorsey.
37. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1(2), 115-129.
38. Schouten, H.J.A. (1999). Sample size formula with a continuous outcome for unequal group sizes and unequal variances. Statistics in Medicine, 18, 87-91.
39. Steering Committee of the Physician's Health Study Research Group. (1988). Preliminary report: Findings from the aspirin component of the ongoing physicians' health study. The New England Journal of Medicine, 318, 262-264.
40. Steiger, J. H., & Fouladi, R. T. (1997). Noncentrality interval estimation and the evaluation of statistical methods. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 221-257). Mahwah, NJ: Lawrence Erlbaum.
41. Stuart, A., & Ord, J. K. (1994). Kendall's advanced theory of statistics: Distribution theory (Vol. 1, 6th ed.). New York: John Wiley.
42. Thompson, B. (1999). Journal editorial polices regarding statistical significance tests: Heat is to fire as p is to importance. Educational Psychology Review, 11, 157-169.
43. Thompson, B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31(3), 25-32.
44. Wainer, H. (1999). One cheer for null hypothesis significance testing. Psychological Methods, 4(2), 212-213.
45. Wilkinson, L., & American Psychological Association Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54(8), 594-604.