The null hypothesis significance test in health sciences research (1995-2006): Statistical analysis and interpretation

BMC Medical Research Methodology

Volumn 10, Issue , 2010, Pages

  Silva Ayçaguer, Luis Carlos ^a   Surez Gil, Patricio ^b   Fernndez Somoano, Ana ^c  

^a CENTRO NACIONAL DE INFORMACIÓN DE CIENCIAS MÉDICAS   (Cuba)

^b Servicio de Salud Del Principado de Asturias (SESPA)   (Spain)

^c UNIVERSITY OF OVIEDO   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HEALTH SERVICES RESEARCH; METHODOLOGY; PROBABILITY; STATISTICAL ANALYSIS; STATISTICS;

DATA INTERPRETATION, STATISTICAL; HEALTH SERVICES RESEARCH; PROBABILITY;

EID: 77952317368     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-10-44     Document Type: Article

References (58)

1. Explorations in statistics: hypothesis tests and P values. D Curran-Everett, Adv Physiol Educ 2009 33 81 86 10.1152/advan.90218.2008 19509391
2. RA Fisher, Statistical Methods for Research Workers Edinburgh: Oliver & Boyd 1925
3. On the use and interpretation of certain test criteria for purposes of statistical inference. J Neyman E Pearson, Biometrika 1928 20 175 240
4. LC Silva, Los laberintos de la investigacián biomédica. En defensa de la racionalidad para la ciencia del siglo XXI Madrid: Díaz de Santos 2009
5. Test of significance considered as evidence. J Berkson, J Am Stat Assoc 1942 37 325 335 10.2307/2279000
6. Null hypothesis significance testing: A review of an old and continuing controversy. RS Nickerson, Psychol Methods 2000 5 241 301 10.1037/1082-989X.5.2. 241 10937333
7. The fallacy of the null hypothesissignificance test. WW Rozeboom, Psychol Bull 1960 57 418 428 10.1037/h0042040
8. Making subjective judgments in quantitative studies: The importance of using effect sizes and confidenceintervals. JL Callahan TG Reio, HRD Quarterly 2006 17 159 173
9. Effect size, confidence interval and statistical significance: a practical guide for biologists. S Nakagawa IC Cuthill, Biol Rev 2007 82 591 605 10.1111/j.1469-185X.2007.00027.x 17944619
10. Effect size estimation: factors to consider and mistakes to avoid. JA Breaugh, J Manage 2003 29 79 97 10.1177/014920630302900106
11. What future quantitative social science research could look like: confidence intervals for effect sizes. B Thompson, Educ Res 2002 31 25 32
12. Significance levels for the assessment of anomalous phenomena. RA Matthews, Journal of Scientific Exploration 1999 13 1 7
13. Nonparametric statistics. IR Savage, J Am Stat Assoc 1957 52 332 333
14. El péndulo bayesiano: Cránica de una polémica estadística. LC Silva A Benavides J Almenara, Llull 2002 25 109 128 17354362
15. Evidence and scientific research. SN Goodman R Royall, Am J Public Health 1988 78 1568 1574 10.2105/AJPH.78.12.1568 3189634
16. Statistical analysis and the illusion of objectivity. JO Berger DA Berry, Am Sci 1988 76 159 165
17. Final collapse of the Neyman-Pearson decision theoretic framework and rise of the neoFisherian. SH Hurlbert CM Lombardi, Ann Zool Fenn 2009 46 311 349
18. Editors can lead researchers to confidence intervals but they can't make them think: Statistical reform lessons from Medicine. F Fidler N Thomason G Cumming S Finch J Leeman, Psychol Sci 2004 15 119 126 10.1111/j.0963-7214.2004. 01502008.x 14738519
19. Calculating the main alternatives to null-hypothesis-significance testing in between-subject experimental designs. N Balluerka AI Vergara J Arnau, Psicothema 2009 21 141 151 19178869
20. Confidence intervals: Better answers to better questions. G Cumming F Fidler, J Psychol 2009 217 15 26
21. A sensible formulation of the significance test. LV Jones JW Tukey, Psychol Methods 2000 5 411 414 10.1037/1082-989X.5.4.411 11194204
22. The p-value fallacy and how to avoid it. P Dixon, Can J Exp Psychol 2003 57 189 202 14596477
23. Effect size, confidence interval and statistical significance: a practical guide for biologists. S Nakagawa IC Cuthill, Biol Rev Camb Philos Soc 2007 82 591 605 10.1111/j.1469-185X.2007.00027.x 17944619
24. Confidence intervals as an alternative to significance testing. E Brandstaetter, MPR-Online 2001 4 33 46
25. Using confidence intervals for graphically based data interpretation. ME Masson GR Loftus, Can J Exp Psychol 2003 57 203 220 14596478
26. Uniform requirements for manuscripts submitted to biomedical journals. International Committee of Medical Journal Editors, http://www.icmje.org Update October 2008. Accessed July 11, 2009
27. P-Values and Confidence Intervals: two sides of the same unsatisfactory coin. AR Feinstein, J Clin Epidemiol 1998 51 355 360 10.1016/S0895-4356(97) 00295-3 9539892
28. Misinterpretations of significance: A problem students share with their teachers? H Haller S Kraus, MRP-Online 2002 7 1 20
29. The null ritual: What you always wanted to know about significance testing but were afraid to ask. G Gigerenzer S Krauss O Vitouch, The Handbook of Methodology for the Social Sciences Thousand Oaks, CA: Sage Publications, Kaplan D, 2004 Chapter 21 391 408
30. Fundamental concepts in statistics: elucidation and illustration. D Curran-Everett S Taylor K Kafadar, J Appl Physiol 1998 85 775 786 9729547
31. RM Royall, Statistical evidence: a likelihood paradigm Boca Raton: Chapman & Hall/CRC 1997
32. Of P values and Bayes: A modest proposal. SN Goodman, Epidemiology 2001 12 295 297 10.1097/00001648-200105000-00006 11337600
33. Tests of statistical significance in three biomedical journals: a critical review. M Sarria LC Silva, Rev Panam Salud Publica 2004 15 300 306 15231076
34. Una ceremonia estadística para identificar factores de riesgo. LC Silva, Salud Colectiva 2005 1 322 329
35. Toward Evidence-Based Medical Statistics 1: The p Value Fallacy. SN Goodman, Ann Intern Med 1999 130 995 1004 10383371
36. Sample size calculations in randomised clinical trials: mandatory and mystical. KF Schulz DA Grimes, Lancet 2005 365 1348 1353 10.1016/S0140-6736(05) 61034-3 15823387
37. Current sample size conventions: Flaws, harms, and alternatives. P Bacchetti, BMC Med 2010 8 17 10.1186/1741-7015-8-17 20307281
38. LC Silva, Disẽo razonado de muestras para la investigacián sanitaria Madrid: Díaz de Santos 2000
39. Tyranny of the p-value: The conflict between statistical significance and common sense. ML Barnett A Mathisen, J Dent Res 1997 76 534 536 10.1177/00220345970760010201 9042074
40. [The Epidat program: uses and perspectives] [letter]. MI Santiago X Hervada G Naveira LC Silva H Farĩas E Vzquez J Bacallao OJ Mjica, Pan Am J Public Health 2010 27 80 82 Spanish.
41. The measurement of observer agreement for categorical data. JR Landis GG Koch, Biometrics 1977 33 159 74 10.2307/2529310 843571
42. Impact of criticism of null-hypothesis significance testing on statistical reporting practices in conservation biology. F Fidler MA Burgman G Cumming R Buttrose N Thomason, Conserv Biol 2005 20 1539 1544 10.1111/j.1523-1739.2006.00525.x
43. RB Kline, Beyond significance testing: Reforming data analysis methods in behavioral research Washington, DC: American Psychological Association 2004
44. Guidelines for reporting statistics in journals published by the American Physiological Society: the sequel. D Curran-Everett DJ Benos, Adv Physiol Educ 2007 31 295 298 10.1152/advan.00022.2007 18057394
45. The spread of statistical significance testing: The case of the Journal of Applied Psychology. R Hubbard AR Parsa MR Luthy, Theor Psychol 1997 7 545 554 10.1177/0959354397074006
46. Reporting practices and APA editorial policies regarding statistical significance and effect size. T Vacha-Haase JE Nilsson DR Reetz TS Lance B Thompson, Theor Psychol 2000 10 413 425 10.1177/0959354300103006
47. Null hypothesis significance testing: On the survival of a flawed method. J Krueger, Am Psychol 2001 56 16 26 10.1037/0003-066X.56.1.16 11242984
48. Reporting Bias in Drug Trials Submitted to the Food and Drug Administration: Review of Publication and Presentation. K Rising P Bacchetti L Bero, PLoS Med 2008 5 217 doi:10.1371/journal.pmed.0050217 10.1371/journal.pmed. 0050217 19067477
49. Editorial policies and publication bias the importance of negative studies. L Sridharan L Greenland, Arch Intern Med 2009 169 1022 1023 10.1001/archinternmed.2009.100 19506169
50. The top-ten in journal impact factor manipulation. ME Falagas VG Alexiou, Arch Immunol Ther Exp (Warsz) 2008 56 223 226 10.1007/s00005-008-0024-5 18661263
51. Writing for Epidemiology. K Rothman, Epidemiology 1998 9 98 104 10.1097/00001648-199805000-00019
52. The fifth edition of the APA publication manual: Why its statistics recommendations are so controversial. F Fidler, Educ Psychol Meas 2002 62 749 770 10.1177/001316402236876 (Pubitemid 36688766)
53. AR Feinstein, Clinical epidemiology: The architecture of clinical research Philadelphia: W.B. Saunders Company 1985
54. Institutionalized dualism: statistical significance testing as myth and ceremony. M Orlitzky, http://ssrn.com/abstract=1415926 Accessed Feb 8, 2010
55. Effect sizes and p-value. What should be reported and what should be replicated? AG Greenwald R Gonzlez RJ Harris D Guthrie, Psychophysiology 1996 33 175 183 10.1111/j.1469-8986.1996.tb02121.x 8851245
56. How statistical expertise is used in medical research. DG Altman SN Goodman S Schroter, J Am Med Assoc 2002 287 2817 2820 10.1001/jama.287.21.2817
57. MJ Gardner DJ Altman, Statistics with confidence. Confidence intervals and statistical guidelines London: BMJ 1992
58. P Values, Hypothesis Tests and Likelihood: implications for epidemiology of a neglected historical debate. SN Goodman, Am J Epidemiol 1993 137 485 496 8465801