Inference without significance: Measuring support for hypotheses rather than rejecting them

Marine Ecology

Volumn 32, Issue 3, 2011, Pages 404-418

  Gerrodette, Tim ^a  

^a SOUTHWEST FISHERIES SCIENCE CENTER   (United States)

Author keywords

Bayesian; Likelihood; Null hypothesis; Phocoena sinus; Significance test; Statistical inference

Indexed keywords

DATA SET; ECOLOGICAL APPROACH; ECOLOGICAL MODELING; EXPERIMENTAL STUDY; HYPOTHESIS TESTING; MARINE ECOSYSTEM; MARINE ENVIRONMENT;

PHOCOENA SINUS; PHOCOENIDAE;

EID: 79961023471     PISSN: 01739565     EISSN: 14390485     Source Type: Journal    
DOI: 10.1111/j.1439-0485.2011.00466.x     Document Type: Article

References (100)

1. Anderson D.R. (2008) Model Based Inference in the Life Sciences: A Primer on Evidence. Springer, New York: 184 pp.
2. Anderson D.R., Burnham K.P., Thompson W.L. (2000) Null hypothesis testing: problems, prevalence, and an alternative. Journal of Wildlife Management, 64(4), 912-923.
3. Bakan D. (1966) The test of significance in psychological research. Psychological Bulletin, 66(6), 423-437.
4. Barlow J., Gerrodette T., Silber G. (1997) First estimates of vaquita abundance. Marine Mammal Science, 13(1), 44-58.
5. Berger J.O. (2003) Could Fisher, Jeffreys and Neyman have agreed on testing? Statistical Science, 18(1), 1-32.
6. Berger J.O., Berry D.A. (1988) Statistical analysis and the illusion of objectivity. American Scientist, 76, 159-165.
7. Berger J.O., Sellke T. (1987) Testing a point null hypothesis: the irreconcilability of P values and evidence. Journal of the American Statistical Association, 82, 112-122.
8. Berkson J. (1938) Some difficulties of interpretation encountered in the application of the chi-square test. Journal of the American Statistical Association, 33(203), 526-536.
9. Berkson J. (1942) Tests of significance considered as evidence. Journal of the American Statistical Association, 37, 325-335.
10. Boring E.G. (1919) Mathematical vs. scientific significance. Psychological Bulletin, 16(10), 335-338.
11. Brosi B.J., Biber E.G. (2009) Statistical inference, Type II error, and decision making under the U.S. Endangered Species Act. Frontiers in Ecology and Environment, 7(9), 487-494.
12. Buckland S.T., Anderson D.R., Burnham K.P., Laake J.L., Borchers D.L., Thomas L. (2001) Introduction to Distance Sampling: Estimating Abundance of Biological Populations. Oxford University Press, New York: 432 pp.
13. Burnham K.P., Anderson D.R. (2002) Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. Springer, New York: 353 pp.
14. Camp R.J., Seavy N.E., Gorresen P.M., Reynolds M.H. (2008) A statistical test to show negligible trend: comment. Ecology, 89(5), 1469-1472.
15. Carver R.P. (1978) The case against statistical significance testing. Harvard Educational Review, 48(3), 378-399.
16. Chernoff H. (1986) A comment. The American Statistician, 40(1), 5-6.
17. Cherry S. (1998) Statistical tests in publications of The Wildlife Society. Wildlife Society Bulletin, 26(4), 947-953.
18. Cohen J. (1988) Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, Hillsdale, NJ: 567 pp.
19. Cohen J. (1994) The earth is round (p<0.05). American Psychologist, 49(12), 997-1003.
20. Connell J.H. (1961) Effects of competition, predation by Thais lapillus, and other factors on natural populations of the barnacle Balanus balanoides. Ecological Monographs, 31, 61-104.
21. Cox D.R. (1977) The role of significance tests. Scandinavian Journal of Statistics, 4(2), 49-70.
22. Dayton P.K. (1971) Competition, disturbance, and community organization: the provision and subsequent utilization of space in a rocky intertidal community. Ecological Monographs, 41, 351-389.
23. Dayton P.K. (1998) Reversal of the burden of proof in fisheries management. Science, 279, 821-822.
24. Dixon P.M., Pechmann J.H.K. (2005) A statistical test to show negligible trend. Ecology, 86(7), 1751-1756.
25. Eberhardt L.L. (2003) What should we do about hypothesis testing? Journal of Wildlife Management, 67(2), 241-247.
26. Edwards W., Lindman H., Savage L.J. (1963) Bayesian statistical inference for psychological research. Psychological Review, 70(3), 193-242.
27. Eguchi T., Gerrodette T. (2009) A Bayesian approach to line-transect analysis for estimating abundance. Ecological Modelling, 220, 1620-1630.
28. Ellison A.M. (1996) An introduction to Bayesian inference for ecological research and environmental decision-making. Ecological Applications, 6, 1036-1046.
29. Fidler F., Burgman M.A., Cumming G., Buttrose R., Thomason N. (2006) Impact of criticism of null-hypothesis significance testing on statistical reporting practices in conservation biology. Conservation Biology, 20(5), 1539-1544.
30. Finney D.J. (1989) Is the statistician still necessary? Biometry Praxometry, 29, 135-146.
31. Fisher R.A. (1925) Statistical Methods for Research Workers. Oliver and Boyd, Edinburgh.
32. Gardner M.J., Altman D.G. (1986) Confidence intervals rather than P values: estimation rather than hypothesis testing. British Medical Journal, 292, 746-750.
33. Gelman A., Carlin J.B., Stern H.S., Rubin D.B. (2004) Bayesian Data Analysis. Chapman & Hall/CRC, Boca Raton: 668 pp.
34. Germano J.D. (1999) Ecology, statistics, and the art of misdiagnosis: the need for a paradigm shift. Environmental Review, 7, 167-190.
35. Gerrodette T. (1987) A power analysis for detecting trends. Ecology, 68, 1364-1372.
36. Gerrodette T., Taylor B.L., Swift R., Rankin S., Jaramillo L.A., Rojas-Bracho L. (2011) A combined visual and acoustic estimate of 2008 abundance, and change in abundance since 1997, for the vaquita, Phocoena sinus. Marine Mammal Science, 27(2), E79-E100.
37. Good I.J. (1992) The Bayes/non-Bayes compromise: a brief review. Journal of the American Statistical Association, 87(419), 597-606.
38. Goodman S.N. (1993) P values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate. American Journal of Epidemiology, 137(5), 485-496.
39. Goodman S.N. (1999) Toward evidence-based medical statistics. 1: the P value fallacy. Annals of Internal Medicine, 103(12), 995-1004.
40. Goodman D. (2004a) Methods for joint inference from multiple data sources for improved estimates of population size and survival rates. Marine Mammal Science, 20(3), 401-423.
41. Goodman D. (2004b) Taking the prior seriously: Bayesian analysis without subjective probability. In: Taper M.L., Lele S.R. (Eds), The Nature of Scientific Evidence: Statistical, Philosophical, and Empirical Considerations. University of Chicago Press, Chicago: 379-400.
42. Goodman S.N., Berlin J.A. (1994) The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results. Annals of Internal Medicine, 121(3), 200-206.
43. Gray B.R., Burlew M.M. (2007) Estimating trend precision and power to detect trends across grouped count data. Ecology, 88(9), 2364-2372.
44. Guthery F.S. (2008) Statistical ritual versus knowledge accrual in wildlife science. Journal of Wildlife Management, 72(8), 1872-1875.
45. Guthery F.S., Lusk J.J., Peterson M.J. (2001) The fall of the null hypothesis: liabilities and opportunities. Journal of Wildlife Management, 65(3), 379-384.
46. Harlow L.L., Mulaik S.A., Steiger J.H. (1997) What If There Were No Significance Tests? Lawrence Erlbaum Associates, Mahwah, NJ: 446 pp.
47. Hilborn R., Mangel M. (1997) The Ecological Detective: Confronting Models with Data. Princeton University Press, Princeton.
48. Hobbs N.T., Hilborn R. (2006) Alternatives to statistical hypothesis testing in ecology: a guide to self teaching. Ecological Applications, 16(1), 5-19.
49. Hoenig J.M., Heisey D.M. (2001) The abuse of power: the pervasive fallacy of power calculations for data analysis. The American Statistician, 55(1), 19-24.
50. Hurlbert S.H., Lombardi C.M. (2009) Final collapse of the Neyman-Pearson decision theoretic framework and rise of the neoFisherian. Annales Zoologici Fennici, 46, 311-349.
51. Inman H.F. (1994) Karl Pearson and R.A. Fisher on statistical tests: a 1935 exchange from Nature. The American Statistician, 48(1), 2-11.
52. Jaramillo-Legorreta A.M., Rojas-Bracho L., Gerrodette T. (1999) A new abundance estimate for vaquitas: first step for recovery. Marine Mammal Science, 15, 957-973.
53. Jaramillo-Legorreta A., Rojas-Bracho L., Brownell R.L. Jr, Read A.J., Reeves R.R., Ralls K., Taylor B.L. (2007) Saving the vaquita: immediate action, not more data. Conservation Biology, 21(6), 1653-1655.
54. Johnson D.H. (1999) The insignificance of statistical significance testing. Journal of Wildlife Management, 63(3), 763-772.
55. Johnson D.H. (2002) The role of hypothesis testing in wildlife science. Journal of Wildlife Management, 66(2), 272-276.
56. Jones L.V. (1955) Statistical theory and research design. Annual Review of Psychology, 6, 405-430.
57. Jones D., Matloff N. (1986) Statistical hypothesis testing in biology: a contradiction in terms. Journal of Economic Entomology, 79(5), 1156-1160.
58. Jones L.V., Tukey J.W. (2000) A sensible formulation of the significance test. Psychological Methods, 5(4), 411-414.
59. Läärä E. (2009) Statistics: reasoning on uncertainty, and the insignificance of testing null. Annales Zoologici Fennici, 46, 138-157.
60. Lecoutre B., Lecoutre M.-P., Poitevineau J. (2001) Uses, abuses and misuses of significance tests in the scientific community: won't the Bayesian choice be unavoidable? International Statistical Review, 69(3), 399-417.
61. Link W.A., Barker R.J. (2010) Bayesian Inference with Ecological Applications. Academic Press, New York: 339 pp.
62. Lubchenco J., Menge B.A. (1978) Community development and persistence in a low rocky intertidal zone. Ecological Monographs, 48, 67-94.
63. Martínez del Rio C., Buskirk S.W., Stephens P.A. (2007) Response to Gibbons et al.: null-hypothesis significance tests in education and inference. Trends in Ecology and Evolution, 22(9), 446.
64. McBride G.B. (2005) Using Statistical Methods for Water Quality Management: Issues, Problems and Solutions. John Wiley & Sons, Inc., Hoboken.
65. McBride G.B., Loftis J.C., Adkins N.C. (1993) What do significance tests really tell us about the environment? Environmental Management, 17(4), 423-432.
66. Meeks S.L., D'Agostino R.B. (1983) A note on the use of confidence limits following rejection of a null hypothesis. The American Statistician, 37(2), 134-136.
67. Mundry R., Nunn C.L. (2009) Stepwise model fitting and statistical inference: turning noise into signal pollution. The American Naturalist, 173(1), 119-123.
68. Nakagawa S., Cuthill I.C. (2007) Effect size, confidence interval and statistical significance: a practical guide for biologists. Biological Reviews, 82(4), 591-605.
69. Nelder J.A. (1985) Comment. Journal of the Royal Statistical Society, A, 148(3), 238.
70. Neyman J., Pearson E.S. (1933) On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London, 231, 289-337.
71. Nickerson R.S. (2000) Null hypothesis significance testing: a review of an old and continuing controversy. Psychological Methods, 5, 241-301.
72. Oakes M. (1986) Statistical Inference: A Commentary for the Social and Behavioural Sciences. John Wiley & Sons, Chichester: 185 pp.
73. Paine R.T. (1966) Food web complexity and species diversity. American Naturalist, 100, 65-75.
74. Patel H.I., Gupta G.D. (1984) A problem of equivalence in clinical trials. Biomedical Journal, 26, 471-474.
75. Peterman R.M., M'Gonigle M. (1992) Statistical power analysis and the precautionary principle. Marine Pollution Bulletin, 24(4), 231-234.
76. Platt J.R. (1964) Strong inference. Science, 146, 347-353.
77. Preece D.A. (1984) Biometry in the Third World: science not ritual. Biometrics, 40, 519-523.
78. Quinn J.F., Dunham A.E. (1983) On hypothesis testing in ecology and evolution. The American Naturalist, 122(5), 602-617.
79. Robinson D.H., Wainer H. (2002) On the past and future of null hypothesis significance testing. Journal of Wildlife Management, 66(2), 263-271.
80. Rojas-Bracho L., Taylor B.L. (1999) Risk factors affecting the vaquita (Phocoena sinus). Marine Mammal Science, 15(4), 974-989.
81. Rojas-Bracho L., Reeves R.R., Jaramillo-Legorreta A. (2006) Conservation of the vaquita Phocoena sinus. Mammal Review, 36(3), 179-216.
82. Royall R.M. (1997) Statistical Evidence: A Likelihood Paradigm. Chapman & Hall, London: 191 pp.
83. Rozeboom W.W. (1960) The fallacy of the null-hypothesis significance test. Psychological Bulletin, 57(5), 416-428.
84. Salsburg D.S. (1985) The religion of statistics as practiced in medical journals. The American Statistician, 39(3), 220-223.
85. Salsburg D. (2001) The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century. W. H. Freeman/Holt Paperbacks, New York: 340 pp.
86. Savage I.R. (1957) Nonparametric statistics. Journal of the American Statistical Association, 52(279), 331-344.
87. Schervish M.J. (1996) P values: what they are and what they are not. The American Statistician, 50(3), 203-206.
88. Skipper J.K. Jr, Guenther A.L., Nass G. (1967) The sacredness of 0.05: a note concerning the uses of statistical level of significance in social science. American Sociologist, 2, 16-18.
89. Steidl R.J., Hayes J.P., Schauber E. (1997) Statistical power analysis in wildlife research. Journal of Wildlife Management, 61(2), 270-279.
90. Stephens P.A., Buskirk S.W., Martínez del Rio C. (2006) Inference in ecology and evolution. Trends in Ecology and Evolution, 22, 192-197.
91. Sterne J.A.C., Davey Smith G. (2001) Sifting the evidence - what's wrong with significance tests? Physical Therapy, 81(8), 1464-1469.
92. Taper M.L., Lele S.R. (2004) The Nature of Scientific Evidence: Statistical, Philosophical, and Empirical Considerations. The University of Chicago Press, Chicago.
93. Taylor B.L., Gerrodette T. (1993) The uses of statistical power in conservation biology: the vaquita and northern spotted owl. Conservation Biology, 7, 489-500.
94. Thomas L. (1997) Retrospective power analysis. Conservation Biology, 11, 276-280.
95. Thomas L., Buckland S.T., Rexstad E.A., Laake J.L., Strindberg S., Hedley S.L., Bishop J.R.B., Marques T.A., Burnham K.P. (2010) Distance software: design and analysis of distance sampling surveys for estimating population size. Journal of Applied Ecology, 47, 5-14.
96. Trafimow D. (2003) Hypothesis testing and theory evaluation at the boundaries: surprising insights from Bayes's theorem. Psychological Review, 110(3), 526-535.
97. Tukey J.W. (1969) Analyzing data: sanctification or detective work? American Psychologist, 24, 83-91.
98. Urquhart N.S., Kincaid T.M. (1999) Designs for detecting trend from repeated surveys of ecological resources. Journal of Agricultural, Biological, and Environmental Statistics, 4, 404-414.
99. Whittingham M.J., Stephens P.A., Bradbury R.B., Freckleton R.P. (2006) Why do we still use stepwise modelling in ecology and behaviour? Journal of Animal Ecology, 75, 1182-1189.
100. Yoccoz N.G. (1991) Use, overuse, and misuse of significance tests in evolutionary biology and ecology. Bulletin of the Ecological Society of America, 72(2), 106-111.