Power, effects, confidence, and significance: An investigation of statistical practices in nursing research

International Journal of Nursing Studies

Volumn 51, Issue 5, 2014, Pages 795-806

  Gaskin, Cadeyrn J ^a,b   Happell, Brenda ^c  

^a Gaskin Research   (Australia)

^b CENTRAL QUEENSLAND UNIVERSITY   (Australia)

^c CENTRAL QUEENSLAND UNIVERSITY   (Australia)

Author keywords

Nursing research; Research design; Review literature as topic; Statistics; Statistics as topic

Indexed keywords

NURSING RESEARCH; PUBLISHING; STATISTICAL ANALYSIS;

DATA INTERPRETATION, STATISTICAL; NURSING RESEARCH; PUBLISHING;

EID: 84897056879     PISSN: 00207489     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijnurstu.2013.09.014     Document Type: Article

References (68)

1. Andersen M.B., Stoové M.A. The sanctity of p<.05 obfuscates good stuff: a comment on Kerr and Goss. Journal of Applied Sport Psychology 1998, 10:168-173.
2. Andrews F.C. Asymptotic behavior of some rank tests for analysis of variance. Annals of Mathematical Statistics 1954, 25:724-736.
3. Beck C.T. Statistical power analysis in pediatric nursing research. Issues in Comprehensive Pediatric Nursing 1994, 17:73-80.
4. Bender R., Lange S. Adjusting for multiple testing - when and how?. Journal of Clinical Epidemiology 2001, 54:343-349.
5. Benjamini Y., Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B (Methodological) 1995, 57:289-300.
6. Bezeau S., Graves R. Statistical power and effect sizes of clinical neuropsychology research. Journal of Clinical and Experimental Neuropsychology 2001, 23:399-406.
7. Bosker R.J., Snijders T.A.B., Guldemond H. PINT (Power IN Two-level Designs) - Estimating Standard Errors of Regression Coefficients in Hierarchical Linear Models for Power Calculations: Users Manual (Version 2.1) 2003, University of Groningen, The Netherlands.
8. Chinn S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Statistics in Medicine 2000, 19:3127-3131.
9. Cohen J. The earth is round (p<.05). American Psychologist 1994, 49:997-1003.
10. Cohen J. A power primer. Psychological Bulletin 1992, 112:155-159.
11. Cohen J. Some statistical issues in psychological research. Handbook of Clinical Psychology 1965, 95-121. McGraw-Hill, New York. B.B. Wolman (Ed.).
12. Cohen J. Statistical power analysis. Current Directions in Psychological Science 1992, 1:98-101.
13. Cohen J. Statistical Power Analysis for the Behavioral Sciences 1988, Erlbaum, Hillsdale, NJ.
14. Cohen J. Things I have learned (so far). American Psychologist 1990, 45:1304-1312.
15. Cumming G., Finch S. A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement 2001, 61:532-574.
16. Faul F., Erdfelder E., Buchner A., Lang A.-G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behavior Research Methods 2009, 41:1149-1160.
17. Faul F., Erdfelder E., Lang A.-G., Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 2007, 39:175-191.
18. Faulkner C., Fidler F., Cumming G. The value of RCT evidence depends on the quality of statistical analysis. Behaviour Research and Therapy 2008, 46:270-281.
19. Ferrin J.M., Bishop M., Tansey T.N., Frain M., Swett E.A., Lane F.J. Conceptual and practical implications for rehabilitation research: effect size estimates, confidence intervals, and power. Rehabilitation Education 2007, 21:87-100.
20. Fritz A., Scherndl T., Kühberger A. A comprehensive review of reporting practices in psychological journals: are effect sizes really enough?. Theory & Psychology 2013, 23:98-122.
21. Gaskin C.J., Happell B. The power of mental health nursing research: a statistical analysis of studies in the International Journal of Mental Health Nursing. International Journal of Mental Health Nursing 2013, 22:69-75.
22. Goodman S.N. Multiple comparisons, explained. American Journal of Epidemiology 1998, 147:807-812.
23. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrica 1988, 75:800-802.
24. Hochberg Y., Benjamini Y. More powerful procedures for multiple significance testing. Statistics in Medicine 1990, 9:811-818.
25. Holm S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics 1979, 6:65-70.
26. Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrica 1988, 75:383-386.
27. Hotelling H., Richards Pabst M. Rank correlation and tests of significance involving no assumption of normality. Annals of Mathematical Statistics 1936, 7:29-43.
28. Houle T.T., Stump D.A. Statistical significance versus clinical significance. Seminars in Cardiothoracic and Vascular Anesthesia 2008, 12:5-6.
29. Huberty C.J. A history of effect size indices. Educational and Psychological Measurement 2002, 62:227-240.
30. Hunt M. How Science Takes Stock: The Story of Meta-Analysis 1997, Russell Sage Foundation, New York.
31. International Committee of Medical Journal Editors Uniform requirements for manuscripts submitted to biomedical journals: manuscript preparation and submission - preparing a manuscript for submission to a biomedical journal 2009, Available from: http://www.ICMJE.org (accessed 17.08.13).
32. Jennions M.D., Møller A.P. A survey of the statistical power of research in behavioral ecology and animal behavior. Behavioral Ecology 2003, 14:438-445.
33. Kim K.H. The relation among fit indexes, power, and sample size in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal 2005, 12:368-390.
34. Kirk R.E. Practical significance: a concept whose time has come. Educational and Psychological Measurement 1996, 56:746-759.
35. Kosciulek J.F., Szymanski E.M. Statistical power analysis of rehabilitation counseling research. Rehabilitation Counseling Bulletin 1993, 36:212-219.
36. Lenth R.V. Some practical guidelines for effective sample size determination. American Statistician 2001, 55:187-193.
37. Lew R., Doros G. Design based on intra-class correlation coefficients. American Journal of Biostatistics 2010, 1:1-8.
38. MacCallum R.C., Browne M.W., Sugawara H.M. Power analysis and determination of sample size for covariance structure modeling. Psychological methods 1996, 1:130-149.
39. MacCallum R.C., Hong S. Power analysis in covariance structure modeling using GFI and AGFI. Multivariate Behavioral Research 1997, 32:193-210.
40. MacCallum R.C., Widaman K.F., Zhang S., Hong S. Sample size in factor analysis. Psychological Methods 1999, 4:84-99.
41. Maddock J.E., Rossi J.S. Statistical power of articles published in three health psychology-related journals. Health Psychology 2001, 20:76-78.
42. Mays M.Z., Melnyk B.M. A call for the reporting of effect sizes in research reports to enhance critical appraisal and evidence-based practice [Editorial]. Worldviews on Evidence-Based Nursing 2009, 6:125-129.
43. Moher D., Hopewell S., Schulz K.F., Montori V., Gøtzsche P.C., Devereaux P.J., Elbourne D., Egger M., Altman D.G. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 2010, 340.
44. Mone M.A., Mueller G.C., Mauland W. The perceptions and usage of statistical power in applied psychology and management research. Personnel Psychology 1996, 49:103-120.
45. Moore S. Statistics. Get it? [Editorial]. Oncology Nursing Forum 2011, 38:105-106.
46. Moran P.A.P. Partial and multiple rank correlation. Biometrika 1951, 38:26-32.
47. Morgan J.F. p value fetishism and use of the Bonferroni adjustment. Evidence Based Mental Health 2007, 10(2):34-35.
48. Mundfrom D.J., Shaw D.G., Tian Lu K. Minimum sample size recommendations for conducting factor analyses. International Journal of Testing 2005, 5:159-168.
49. Murphy K., Myors B., Wolach A. Statistical Power Analysis: A Simple and General Model for Traditional and Modern Hypothesis Tests 2009, Taylor & Francis, New York, NY.
50. Norman I., Griffiths P. Duplicate publication and 'salami slicing': ethical issues and practical solutions [Editorial]. International Journal of Nursing Studies 2008, 45:1257-1260.
51. Perneger T.V. What's wrong with Bonferroni adjustments. BMJ 1998, 316:1236-1238.
52. Polit D.F., Beck C.T. Nursing Research: Generating and Assessing Evidence for Nursing Practice 2012, Lippincott Williams & Wilkins, Philadelphia.
53. Polit D.F., Sherman R.E. Statistical power in nursing research. Nursing Research 1990, 39:365-369.
54. Prentice R. Invited commentary: ethics and sample size - another view. American Journal of Epidemiology 2005, 161:111-112.
55. Raudenbush S.W., Spybrook J., Congdon R., Liu X., Martinez A., Bloom H., Hill C. Optimal Design Plus Empirical Evidence 2011, William T. Grant Foundation, New York, NY.
56. Rodgers J.L. The epistemology of mathematical and statistical modeling: a quiet methodological revolution. American Psychologist 2010, 65:1-12.
57. Savitz D.A., Olshan A.F. Multiple comparisons and related issues in the interpretation of epidemiologic data. American Journal of Epidemiology 1995, 142:904-908.
58. Schatz P., Jay K.A., McComb J., McLaughlin J.R. Misuse of statistical tests in Archives of Clinical Neuropsychology publications. Archives of Clinical Neuropsychology 2005, 20:1053-1059.
59. Smith D.R., Hardy I.C.W., Gammell M.P. Power rangers: no improvement in the statistical power of analyses published in Animal Behaviour. Animal Behaviour 2011, 81:347-352.
60. Snijders T.A.B., Bosker R.J. Standard errors and sample sizes for two-level research. Journal of Educational and Behavioral Statistics 1993, 18:237-259.
61. Speed H.D., Andersen M.B. What exercise and sport scientists don't understand. Journal of Science and Medicine in Sport 2000, 3:84-92.
62. Spybrook J., Bloom H., Congdon R., Hill C., Martinez A., Raudenbush S.W. Optimal Design Plus Empirical Evidence: Documentation for the "Optimal Design" Software Version 3.0 2011, William T. Grant Foundation, New York, NY.
63. Sterne J.A.C., Smith G.D. Sifting the evidence - what's wrong with significance tests?. BMJ 2001, 322:226-231.
64. Thompson B. What future quantitative social science research could look like: confidence intervals for effect sizes. Educational Researcher 2002, 31(3):25-32.
65. Thompson J.R. Invited commentary: Re: "Multiple comparisons and related issues in the interpretation of epidemiologic data". American Journal of Epidemiology 1998, 147:801-806.
66. van Elteren P.H., Noether G.E. The asymptotic efficiency of the χr2-test for a balanced incomplete block design. Biometrika 1959, 46:475-477.
67. Westfall P.H., Young S.S. Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment 1993, Wiley, New York, NY.
68. Zhang J., Yu K.F. What's the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes. JAMA 1998, 280:1690-1691.