Alternatives to statistical hypothesis testing in ecology: A guide to self teaching

Ecological Applications

Volumn 16, Issue 1, 2006, Pages 5-19

  Hobbs, N Thompson ^a   Hilborn, Ray ^b  

^a Department of Environmental and Radiological Health Sciences   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

AIC; Bayesian; Ecological modeling; Information theoretic; Likelihood; Meta analysis; Model selection

Indexed keywords

BAYESIAN ANALYSIS; MAXIMUM LIKELIHOOD ANALYSIS; STATISTICAL ANALYSIS;

ALGORITHM; BAYES THEOREM; BIOLOGICAL MODEL; BIOLOGY; COMPUTER SIMULATION; CONFERENCE PAPER; ECOLOGY; ECOSYSTEM; META ANALYSIS; METHODOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; BAYES THEOREM; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; ECOLOGY; ECOSYSTEM; LIKELIHOOD FUNCTIONS; META-ANALYSIS; MODELS, BIOLOGICAL; RESEARCH DESIGN;

EID: 33645105391     PISSN: 10510761     EISSN: 10510761     Source Type: Journal    
DOI: 10.1890/04-0645     Document Type: Conference Paper

References (127)

1. Aguiar, M. R., and O. E. Sala. 1999. Patch structure, dynamics and implications for the functioning of arid ecosystems. Trends in Ecology and Evolution 14:273-277.
2. Akaike, H. 1973. Information theory as an extension of the maximum likelihood principle. Pages 267-281 in B. N. Petrov and F. F. Csaki, editors. Second International Symposium on Information Theory. Akademiai Kiado, Budapest, Hungary.
3. Allcock, K. G., and D. S. Hik. 2003. What determines disturbance- productivity-diversity relationships? The effect of scale, species and environment on richness patterns in an Australian woodland. Oikos 102:173-185.
4. Anderson, D. R., K. P. Burnham, and W. L. Thompson. 2000. Null hypothesis testing: problems, prevalence, and an alternative. Journal of Wildlife Management 64:912-923.
5. Anderson, M. T., and D. A. Frank. 2003. Defoliation effects on reproductive biomass: importance of scale and timing. Journal of Range Management 56:501-516.
6. Aoki, M. 1987. State space modeling of time series. Springer-Verlag, New York, New York, USA.
7. Azzalini, A. 1996. Statistical inference based on the likelihood. Chapman and Hall, London, UK.
8. Bailey, N. T. J. 1967. The mathematical approach to biology and medicine. Wiley, New York, New York, USA.
9. Barnthouse, L. W., and W. Van Winkle. 1988. Analysis of impingement impacts on Hudson River fish populations. Pages 182-190 in Science, law and Hudson River power plants: a case study in environmental impact assessment. American Fisheries Society, Bethesda, Maryland, USA.
10. Bell, T., W. E. Neill, and D. Schluter. 2003. The effect of temporal scale on the outcome of trophic cascade experiments. Oecologia 134:578-586.
11. Belsky, A. J. 1986. Does herbivory benefit plants - a review of the evidence. American Naturalist 127:870-892.
12. Bender, D. J., T. A. Contreras, and L. Fahrig. 1998. Habitat loss and population decline: a meta-analysis of the patch size effect. Ecology 79:517-533.
13. Berger, J. O. 1985. Statistical decision theory and Bayesian analysis. Springer-Verlag, New York, New York, USA.
14. Berger, J. O., and T. Sellke. 1987. Testing a point null hypothesis: the irreconcilability of P values and evidence. Journal of the American Statistician Association 82:112-122.
15. Bjornstad, O. N., B. F. Finkenstadt, and B. T. Grenfell. 2002. Dynamics of measles epidemics: estimating scaling of transmission rates using a time series SIR model. Ecological Monographs 72:169-184.
16. Bullock, J. M., R. F. Pywell, M. J. W. Burke, and K. J. Walker. 2001. Restoration of biodiversity enhances agricultural production. Ecology Letters 4:185-189.
17. Burnham, K. P., and D. R. Anderson. 2002. Model selection and multi-model inference: a practical information-theoretic approach. Springer-Verlag, New York, New York, USA.
18. Calder, C., M. Lavine, P. Muller, and J. S. Clark. 2003. Incorporating multiple sources of stochasticity into dynamic population models. Ecology 84:1395-1402.
19. Callaway, R. M. 1995. Positive interactions among plants. Botanical Review 61:306-349.
20. Cameron, J., and J. Abouchar. 1991. The precautionary principle: a fundamental principle of law and policy for the protection of the global environment. Boston College International and Comparative Law Review 14:1-27.
21. Canham, C. D., and M. Uriarte. 2006. Analysis of neighborhood dynamics of forest ecosystems using likelihood methods and modeling. Ecological Applications 16:62-73.
22. Case, T. J. 2000. An illustrated guide to theoretical ecology. Oxford University Press, Oxford UK.
23. Caswell, H. 1988. Matrix population models. Sinauer, Sunderland, Massachusetts, USA.
24. Chalfoun, A. D., F. R. Thompson, and M. J. Ratnaswamy. 2002. Nest predators and fragmentation: a review and meta-analysis. Conservation Biology 16:306-318.
25. Clark, J. S. 2003. Uncertainty and variability in demography and population growth: a hierarchical approach. Ecology 84:1370-1381.
26. Clayton, D., and M. Hills. 1998. Statistical models in epidemiology. Oxford Science Publications, Oxford, UK.
27. Clemen, R. T. 1996. Making hard decisions: an introduction to decision analysis. Duxbury Press, Belmont, California, USA.
28. Connor, E. F., A. C. Courtney, and J. M. Yoder. 2000. Individuals-area relationships: the relationship between animal population density and area. Ecology 81:734-748.
29. Cooper, A. B., R. Hilborn, and J. W. Unsworth. 2003. An approach for population assessment in the absence of abundance indices. Ecological Applications 13:814-828.
30. Deangelis, D. L., and M. A. Huston. 1993. Further considerations on the debate over herbivore optimization theory. Ecological Applications 3:30-31.
31. Dennis, B. 1996. Discussion: should ecologists become Bayesians? Ecological Applications 6:1095-1103.
32. Dennis, B., and M. R. M. Otten. 2000. Joint effects of density dependence and rainfall on abundance of San Joaquin kit fox. Journal of Wildlife Management 64:388-400.
33. Detling, J. K. 1988. Grasslands and savannas-regulation of energy flow and nutrient cycling by herbivores. Pages 131-148 in L. R. Pomeroy and J. J. Alberts, editors. Concepts in ecosystem ecology: a comparative view. Sprinter-Verlag, Berlin, Germany.
34. De Valpine, P., and A. Hastings. 2002. Fitting population models incorporating process noise and observation error. Ecological Monographs 72:57-76.
35. Dorn, M. W. 2002. Advice on West Coast rockfish harvest rates from Bayesian meta-analysis of stock-recruit relationships. North American Journal of Fisheries Management 22:280-300.
36. Downing, A. L., and M. A. Leibold. 2002. Ecosystem consequences of species richness and composition in pond food webs. Nature 416:837-841.
37. Edelstein-Keshet, L. 1988. Mathematical models in biology. McGraw Hill, New York, New York, USA.
38. Edwards, E. W. F. 1992. Likelihood. Johns Hopkins University Press, Baltimore, Maryland, USA.
39. Efron, B. 1986. Why isn't everyone a Bayesian? American Statistician 40:1-11.
40. Fahrig, L. 2002. Effect of habitat fragmentation on the extinction threshold: a synthesis. Ecological Applications 12:346-353.
41. Fidler, F., N. Thomason, G. Cumming, S. Finch, and J. Leeman. 2004. Editors can lead researchers to confidence intervals, but can't make them think-statistical reform lessons from medicine. Psychological Science 15:119-126.
42. Food and Agriculture Organization of the United Nations (FAO). 1996. Precautionary approach to capture fisheries and species introductions. Food and Agriculture Organization of the United Nations, Rome, Italy.
43. Forchhammer, M. C., N. C. Stenseth, E. Post, and R. Langvatn. 1993. Population dynamics of Norwegian red deer: density-dependence and climatic variation. Proceedings of the Royal Society of London Series B: Biological Sciences 265:341-350.
44. Foster, K. R., P. Vecchia, and M. H. Repacholi. 2000. Risk management - science and the precautionary principle. Science 288:979.
45. Fournier, D. A., and C. Archibald. 1982. A general theory for analyzing catch at age data. Canadian Journal of Fisheries and Aquatic Sciences 39:1195-1207.
46. Frank, D. A., M. M. Kuns, and D. R. Guido. 2002. Consumer control of grassland plant production. Ecology 83:602-606.
47. Frank, D. A., S. J. McNaughton, and B. F. Tracy. 1998. The ecology of the Earth's grazing ecosystems. BioScience 48:513-521.
48. Fretwell, S. 1972. Populations in a seasonal environment. Princeton University Press, Princeton, New Jersey, USA.
49. Garrott, R. A., L. L. Eberhardt, P. J. White, and J. Rotella. 2003. Climate-induced variation in vital rates of an unharvested large-herbivore population. Canadian Journal of Zoology-Revue Canadienne De Zoologie 81:33-45.
50. Gelman, A., J. B. Carlin, H. S. Stern, and D. B. Rubin. 1995. Bayesian data analysis. Chapman and Hall, London, UK.
51. Gende, S. M., T. P. Quinn, R. Hilborn, A. P. Hendry, and B. Dickerson. 2004. Brown bears selectively kill salmon with higher energy content but only in habitats that facilitate choice. Oikos 104:518-528.
52. Georgiadis, N. J., R. W. Ruess, S. J. McNaughton, and D. Western. 1989. Ecological conditions that determine when grazing stimulates grass production. Oecologia 81:316-322.
53. Gershenfeild, N. 1999. The nature of mathematical modeling. Cambridge University Press, London, UK.
54. Goodman, S. N. 1999. Toward evidence-based medical statistics. 1: the P value fallacy. Annals of Internal Medicine 130:995-1004.
55. Gotelli, N. J. 1998. A primer of ecology. Sinauer, Sunderland, Massachusetts, USA.
56. Grenfell, B. T., K. Wilson, B. F. Finkenstadt, T. N. Coulson, S. Murray, S. D. Albon, J. M. Pemberton, T. H. Clutton-Brock, and M. J. Crawley. 1998. Noise and determinism in synchronized sheep dynamics. Nature 394:674-677.
57. Gurevitch, J., P. S. Curtis, and M. H. Jones. 2001. Meta-analysis in ecology. Advances in Ecological Research 32:199-247.
58. Gurney, W. S. C., and R. M. Nisbet. 1998. Ecological dynamics. Oxford University Press, New York, New York, USA.
59. Haefner, J. W. 1996. Modeling biological systems: principles and applications. Chapman and Hall, London, UK.
60. Halbert, C. L., and K. N. Lee. 1991. Implementing adaptive management - a conversation with Lee, Kai N. Northwest Environmental Journal 7:136-150.
61. Hall, C. A. S. 1988. An assessment of several of the historically most influential theoretical models used in ecology and the data provided in their support. Ecological Modeling 43:5-31.
62. Hastings, A. 1997. Population biology: concepts and models. Springer-Verlag, New York, New York, USA.
63. Hedges, L. V., and I. Olkin. 1985. Statistical methods for meta-analysis. Academic Press, Orlando, Florida, USA.
64. Hilborn, R. 1997. Statistical hypothesis testing and decision theory in fisheries science. Fisheries 20:19-20.
65. Hilborn, R., and M. Liermann. 1998. Standing on the shoulders of giants: learning from experience in fisheries. Reviews in Fish Biology and Fisheries 8:273-283.
66. Hilborn, R., J. J. Maguire, A. M. Parma, and A. A. Rosenberg. 2001. The precautionary approach and risk management: can they increase the probability of successes in fishery management? Canadian Journal of Fisheries and Aquatic Sciences 58:99-107.
67. Hilborn, R., and M. Mangel. 1997. The ecological detective: confronting models with data. Princeton University Press, Princeton, New Jersey, USA.
68. Hilborn, R., and C. J. Walters. 1992. Quantitative fisheries stock assessment: choice, dynamics and uncertainty. Chapman and Hall, New York, New York, USA.
69. Hillebrand, H., and B. J. Cardinale. 2004. Consumer effects decline with prey diversity. Ecology Letters 7:192-201.
70. Hobbs, N. T., J. E. Gross, L. A. Shipley, D. E. Spalinger, and B. A. Wunder. 2003. Herbivore functional response in heterogeneous environments: a contest among models. Ecology 84:666-681.
71. Hobbs, N. T., S. Twombly, and D. Schimel. 2006. Deepening ecological insights using contemporary statistics. Ecological Applications 16:3-4.
72. Holm, S., and J. Harris. 1999. Precautionary principle stifles discovery. Nature 400:398.
73. Howson, C., and P. Urbach. 1991. Bayesian reasoning in science. Nature 350:371-374.
74. Hunt, M. 1997. How science takes stocks. A history of meta-analysis. Russell Sage Foundation, New York, New York, USA.
75. Huxel, G. R. 1999. On the influence of food quality in consumer-resource interactions. Ecology Letters 2:256-261.
76. Jeffreys, W. H., and J. O. Berger. 1992. Ockham's razor and Bayesian analysis. American Scientist 80:64-72.
77. Johnson, D. H. 1999. The insignificance of statistical significance testing. Journal of Wildlife Management 63:763-772.
78. Johnson, J. B., and K. S. Omland. 2004. Model selection in ecology and evolution. Trends in Ecology and Evolution 19:101-108.
79. Lee, K. N. 1993. Compass and gyroscope: integrating science and politics for the environment. Island Press, Washington, D.C., USA.
80. Lee, K. N., and J. Lawrence. 1986. Adaptive management: learning from the Columbia River basin fish and wildlife program. Environmental Law 16:431-460.
81. Leibold, M. A., J. M. Chase, J. B. Shurin, and A. L. Downing. 1997. Species turnover and the regulation of trophic structure. Annual Review of Ecology and Systematics 28:467-494.
82. Link, W. A., E. Cam, J. D. Nichols, and E. G. Cooch. 2002. Of bugs and birds: Markov chain Monte Carlo for hierarchical modeling in wildlife research. Journal of Wildlife Management 66:277-291.
83. Lubow, B. C., F. J. Singer, T. L. Johnson, and D. C. Bowden. 2002. Dynamics of interacting elk populations within and adjacent to Rocky Mountain National Park. Journal of Wildlife Management 66:757-775.
84. Mann, C. 1990. Meta-analysis in the breech. Science 249:479-480.
85. May, R. M., editor. 1981. Theoretical ecology: principles and applications. Sinauer, Sunderland, Massachusetts, USA.
86. McCann, K. S., A. Hastings, and D. R. Strong. 1998. Trophic cascades and trophic trickles in pelagic food webs. Proceedings of the Royal Society of London Series B-Biological Sciences 265:205-209.
87. McLain, R. J., and R. G. Lee. 1996. Adaptive management: promises and pitfalls. Environmental Management 20:437-448.
88. McNaughton, S. J. 1979. Grazing as an optimization process - grass ungulate relationships in the Serengeti. American Naturalist 113:691-703.
89. McNaughton, S. J. 1983. Serengeti grassland ecology: the role of composite environmental factors and contingency in community organization. Ecological Monographs 53:291-320.
90. Mduma, S. A. R., A. R. E. Sinclair, and R. Hilborn. 1999. Food regulates the Serengeti wildebeest: a 40-year record. Journal of Animal Ecology 68:1101-1122.
91. M'Gonigle, R. M., T. L. Jameison, M. K. McAllister, and R. M. Peterman. 1994. Taking uncertainty seriously: from permissive regulation to preventative design in environmental decision making. Osgoode Hall Law Journal 32:99-169.
92. Mood, A. M., F. A. Graybill, and D. C. Boes. 1963. Introduction to the theory of statistics. Third edition. McGraw-Hill, New York, New York, USA.
93. Myers, R. A. 2001. Stock and recruitment: generalizations about maximum reproductive rate, density dependence, and variability using meta-analytic approaches. ICES Journal of Marine Science 58:937-951.
94. Myers, R. A., N. J. Barrowman, R. Hilborn, and D. G. Kehler. 2002. Inferring Bayesian priors with limited direct data: applications to risk analysis. North American Journal of Fisheries Management 22:351-364.
95. Myers, R. A., B. R. MacKenzie, K. G. Bowen, and N. J. Barrowman. 2001. What is the carrying capacity for fish in the ocean? A meta-analysis of population dynamics of North Atlantic cod. Canadian Journal of Fisheries and Aquatic Sciences 58:1464-1476.
96. Newman, K. B., S. T. Buckland, S. T. Lindley, L. Thomas, and C. Fernández. 2006. Hidden process models for animal population dynamics. Ecological Applications 16:74-86.
97. Noy-Meir, I. 1993. Compensating growth of grazed plants and its relevance to the use of rangelands. Ecological Applications 3:17-20.
98. Nystrom, P., A. R. McIntosh, and M. J. Winterbourn. 2003. Top-down and bottom-up processes in grassland and forested streams. Oecologia 136:596-608.
99. Onstad, D. W. 1988. Population-dynamic theory: the roles of analytical, simulation, and super computer models. Ecological Modeling 43:111-124.
100. Pawitan, Y. 2001. In all likelihood: statistical modeling and inference using likelihood. Oxford Scientific Publications, Oxford, UK.
101. Peterman, R. M., and M. M'Gonigle. 1992. Statistical power analysis and the precautionary principle. Marine Pollution Bulletin 24:231-234.
102. Platt, J. R. 1964. Strong inference - certain systematic methods of scientific thinking may produce much more rapid progress than others. Science 146:347-353.
103. Polis, G. A., A. L. W. Sears, G. R. Huxel, D. R. Strong, and J. Maron. 2000. When is a trophic cascade a trophic cascade? Trends in Ecology and Evolution 15:473-475.
104. Punt, A. E., and R. Hilborn. 1997. Fisheries stock assessment and decision analysis: the Bayesian approach. Reviews in Fish Biology and Fisheries 7:35-63.
105. Punt, A. E., and R. Hilborn. 2002. Bayesian stock assessment methods in fisheries. Food and Agriculture Organization of the United Nations, Rome, Italy.
106. Royall, R. 1997. Statistical evidence: a likelihood paradigm. Chapman and Hall/CRC, New York, New York, USA.
107. Sala, O. E. 2001. Ecology-price put on biodiversity. Nature 412:34-36.
108. Sauer, J. R., and W. A. Link. 2002. Hierarchical modeling of population stability and species group attributes from survey data. Ecology 83:1743-1751.
109. Schlapfer, F., and B. Schmid. 1999. Ecosystem effects of biodiversity: a classification of hypotheses and exploration of empirical results. Ecological Applications 9:893-912.
110. Schmitz, O. J., P. A. Hamback, and A. P. Beckerman. 2000. Trophic cascades in terrestrial systems: a review of the effects of carnivore removals on plants. American Naturalist 155:141-153.
111. Schnute, J. T. 1994. A general framework for developing sequential fisheries models. Canadian Journal of Fisheries and Aquatic Sciences 51:1676-1688.
112. Schnute, J. T., and A. R. Kronlund. 2002. Estimating salmon stock-recruitment relationships from catch and escapement data. Canadian Journal of Fisheries and Aquatic Sciences 59:433-449.
113. Steinauer, E. M., and S. L. Collins. 2001. Feedback loops in ecological hierarchies following urine deposition in tall-grass prairie. Ecology 82:1319-1329.
114. Strong, D. R., A. V. Whipple, A. L. Child, and B. Dennis. 1999. Model selection for a subterranean trophic cascade: root-feeding caterpillars and entomopathogenic nematodes. Ecology 80:2750-2761.
115. Tanaka, S., and R. Nishii. 1997. Model of deforestation by human population interactions. Environmental and Ecological Statistics 4:83-91.
116. Taubes, C. H. 2001. Modeling differential equations in biology. Prentice Hall, Upper Saddle River, New Jersey, USA.
117. Ulanowicz, R. E. 1988. On the importance of higher-level models in ecology. Ecological Modeling 43:45-56.
118. Vucetich, J. A., R. O. Peterson, and C. L. Schaefer. 2002. The effect of prey and predator densities on wolf predation. Ecology 83:3003-3013.
119. Wachter, K. W. 1988. Disturbed by meta-analysis? Science 241:1407-1408.
120. Walters, C., and D. Ludwig. 1994. Calculations of Bayes posterior probability distributions for key population parameters. Canadian Journal of Fisheries and Aquatic Sciences 51:713-722.
121. Walters, C. J. 1986. Adaptive management of renewable resources. Macmillan, New York, New York, USA.
122. Walters, C. J., and R. Green. 1997. Valuation of experimental management options for ecological systems. Journal of Wildlife Management 61:987-1006.
123. Walters, C. J., and R. Hilborn. 1978. Ecological optimization and adaptive management. Marine Environmental Research 9:157-188.
124. Walters, C. J., and C. S. Holling. 1990. Large-scale management experiments and learning by doing. Ecology 71:2060-2068.
125. White, G. C., and B. C. Lubow. 2002. Fitting population models to multiple sources of observed data. Journal of Wildlife Management 66:300-309.
126. Worm, B., and J. E. Duffy. 2003. Biodiversity, productivity and stability in real food webs. Trends in Ecology and Evolution 18:628-632.
127. Worm, B., H. K. Lotze, H. Hillebrand, and U. Sommer. 2002. Consumer versus resource control of species diversity and ecosystem functioning. Nature 417:848-851.