Sifting the evidence—what's wrong with significance tests?

BMJ

Volumn 322, Issue 7280, 2001, Pages 226-

  Sterne, Jonathan A C ^a   Smith, George Davey ^a   Cox, D R ^b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b NUFFIELD COLLEGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EVIDENCE BASED MEDICINE; MEDICAL LITERATURE; MEDICAL RESEARCH; PRIORITY JOURNAL; REVIEW; STATISTICAL ANALYSIS; STATISTICS; BAYES THEOREM; HISTORY; HUMAN; METHODOLOGY; RESEARCH;

BAYES THEOREM; DATA INTERPRETATION, STATISTICAL; HISTORY, 20TH CENTURY; HUMANS; RESEARCH; STATISTICS;

EID: 0035956651     PISSN: 09598138     EISSN: 14685833     Source Type: Journal    
DOI: 10.1136/bmj.322.7280.226     Document Type: Article

References (44)

1. Le Fanu J. The rise and fall of modern medicine. New York: Little, Brown, 1999.
2. Berlin JA, Begg CB, Louis TA. An assessment of publication bias using a sample of published clinical trials. J Am Stat Assoc 1989; 84: 381-392.
3. Easterbrook PJ, Berlin JA, Gopalan R, Matthews Dr. Publication bias in clinical research. Lancet 1991; 337: 867-872.
4. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA 1992; 263: 374-378.
5. Mayes LC, Horwitz RI, Feinstein AR. A collection of 56 topics with contradictory results in case-control research. Int J Epidemiol 1988; 17: 680-685.
6. Goodman SN. P values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate. Am J Epidemiol 1993; 137: 485-496.
7. Lehmann EL. The Fisher, Neyman-Pearson theories of testing hypotheses: one theory or two? J Am Stat Assoc 1993; 88: 1242-1249.
8. Goodman SN. Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med 1999; 130: 995-1004.
9. Fisher RA. Statistical methods for research workers. London: Oliver and Boyd, 1950: 80.
10. Neyman J, Pearson E. On the problem of the most efficient tests of statistical hypotheses. Philos Trans Roy Soc A 1933; 231: 289-337.
11. Fisher RA. Statistical methods and scientific inference. London: Collins Macmillan, 1973.
12. Feinstein AR. P-values and confidence intervals: two sides of the same unsatisfactory coin. J Clin Epidemiol 1998; 51: 355-360.
13. Berkson J. Tests of significance considered as evidence. J Am Stat Assoc 1942; 37: 325-335.
14. Rozeboom WW. The fallacy of the null-hypothesis significance test. Psychol Bull 1960; 57: 416-428.
15. Freiman JA, Chalmers TC, Smith HJ, Kuebler RR. The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 “negative” trials. N Engl J Med 1978; 299: 690-694.
16. Cox Dr. Statistical significance tests. Br J Clin Pharmacol 1982; 14: 325-331.
17. Rothman KJ. Significance questing. Ann Intern Med 1986; 105: 445-447.
18. Altman DG, Gore SM, Gardner MJ, Pocock SJ. Statistical guidelines for contributors to medical journals. BMJ 1983; 286: 1489-1493.
19. Gardner MJ, Altman DG. Confidence intervals rather than P values: estimation rather than hypothesis testing. BMJ 1986; 292: 746-750.
20. Gardner MJ, Altman DG. Statistics with confidence. Confidence intervals and statistical guidelines. London: BMJ Publishing, 1989.
21. Hopkins PN, Williams RR. Identification and relative weight of cardiovascular risk factors. Cardiol Clin 1986; 4: 3-31.
22. Freiman JA, Chalmers TC, Smith H, Kuebler RR. The importance of beta, the type II error, and sample size in the design and interpretation of the randomized controlled trial. In: BailarJC,MostellerF, eds. Medical uses of statistics. Boston, Ma: NEJM Books, 1992: 357-373.
23. Moher D, Dulberg CS, Wells GA. Statistical power, sample size, and their reporting in randomized controlled trials. JAMA 1994; 272: 122-124.
24. Mulward S, Gtzsche PC. Sample size of randomized double-blind trials 1976-1991. Dan Med Bull 1996; 43: 96-98.
25. Oakes M. Statistical inference. Chichester: Wiley, 1986.
26. Browner WS, Newman TB. Are all significant P values created equal? The analogy between diagnostic tests and clinical research. JAMA 1987; 257: 2459-2463.
27. Edwards W, Lindman H, Savage LJ. Bayesian statistical inference for psychological research. Psychol Rev 1963; 70: 193-242.
28. Berger JO, Sellke T. Testing a point null hypothesis: the irreconcilability of P values and evidence. J Am Stat Assoc 1987; 82: 112-122.
29. Lilford RJ, Braunholtz D. The statistical basis of public policy: a paradigm shift is overdue. BMJ 1996; 313: 603-607.
30. Brophy JM, Joseph L. Placing trials in context using Bayesian analysis. GUSTO revisited by Reverend Bayes. JAMA 1995; 273: 871-875.
31. Burton PR, Gurrin LC, Campbell MJ. Clinical significance not statistical significance: a simple Bayesian alternative to p values. J Epidemiol Community Health 1998; 52: 318-323.
32. Goodman SN. Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med 1999; 130: 1005-1013.
33. Phillips AN, Davey Smith G. The design of prospective epidemiological studies: more subjects or better measurements? J Clin Epidemiol 1993; 46: 1203-1211.
34. Yusuf S, Collins R, Peto R. Why do we need some large, simple randomized trials? Stat Med 1984; 3: 409-422.
35. Egger M, Davey Smith G. Meta-analysis. Potentials and promise. BMJ 1997; 315: 1371-1374.
36. Danesh J, Whincup P, Walker M, Lennon L, Thomson A, Appleby P, et al. Chlamydia pneumoniae IgG titres and coronary heart disease: prospective study and meta-analysis. BMJ 2000; 321: 208-213.
37. Morris JN. The uses of epidemiology. Edinburgh: Churchill-Livingstone, 1975.
38. Davey Smith G. Reflections on the limits to epidemiology. J Clin Epidemiol (in press).
39. Cole P. The hypothesis generating machine. Epidemiology 1993; 4: 271-273.
40. Davey Smith G, Phillips AN. Confounding in epidemiological studies: why “independent” effects may not be all they seem. BMJ 1992; 305: 757-759.
41. Fisher RA. Statistical methods for research workers. 1st ed. Edinburgh: Oliver and Boyd, 1925. Reprinted by Oxford University Press.
42. Fisher RA. Design of experiments. 1st ed. Edinburgh: Oliver and Boyd, 1935. Reprinted by Oxford University Press.
43. Yates F. The 25th anniversary of statistical methods for research workers. J Am Stat Assoc 1950; 46: 19-34.
44. Cox Dr. Statistical significance tests. Br J Clin Pharmacol 1982; 14: 325-331.