Assessing the reliability of ecological monitoring data: Power analysis and alternative approaches

Natural Areas Journal

Volumn 27, Issue 1, 2007, Pages 83-91

  Morrison, Lloyd W ^a  

^a MISSOURI STATE UNIVERSITY   (United States)

Author keywords

Confidence intervals; Null hypothesis significance testing; Parameter estimation; Power analysis; Type II error

Indexed keywords

ASSESSMENT METHOD; CONSERVATION MANAGEMENT; DATA PROCESSING; ENVIRONMENTAL MONITORING; MANAGEMENT PRACTICE; NATURAL RESOURCE; RELIABILITY ANALYSIS; STATISTICAL ANALYSIS;

EID: 33846817446     PISSN: 08858608     EISSN: None     Source Type: Journal    
DOI: 10.3375/0885-8608(2007)27[83:ATROEM]2.0.CO;2     Document Type: Review

References (85)

1. Abelson, R.P. 1997. A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented). Pp 117-141 in L.L. Harlow, S.A. Mulaik, and J.H. Steiger, eds., What If There Were No Significance Tests? Lawrence Erlbaum, Mahwah, N.J.
2. Anderson, D.R., K.P. Burnham, and W.L. Thompson. 2000. Null hypothesis testing: problems, prevalence, and an alternative. Journal of Wildlife Management 64:912-923.
3. Anderson, D.R., W.A. Link, D.H. Johnson, and K.P. Burnham. 2001. Suggestions for presenting the results of data analyses. Journal of Wildlife Management 65:373-378.
4. Berger, R.L., and J.C. Hsu. 1996. Bioequivalence trials, intersection-union tests and equivalence confidence sets. Statistical Science 11:283-319.
5. Birnbaum, A. 1977. The Neyman-Pearson theory as decision theory, and as inference theory; with a criticism of the Lindsley-Savage argument for Bayesian theory. Synthese 36:19-49.
6. Burnham, K.P., and D.R. Anderson. 1998. Model Selection and Inference. Springer-Verlag, New York.
7. Burnham, K.P., and D.R. Anderson. 2002. Model Selection and Multi-model Inference. Springer-Verlag, New York.
8. Carver, R.P. 1978. The case against statistical significance testing. Harvard Educational Review 48:378-399.
9. Carver, R.P. 1993. The case against statistical significance testing, revisited. Journal of Experimental Education 61:287-292.
10. Cherry, S. 1998. Statistical tests in publications of The Wildlife Society. Wildlife Society Bulletin 26:947-953.
11. Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences. Lawrence-Erlbaum, Hillsdale, N.J.
12. Cohen, J. 1994. The earth is round (p < 0.05). American Psychologist 49:997-1003.
13. Colegrave, N., and G.D. Ruxton. 2003. Confidence intervals are a more useful complement to nonsignificant tests than are power calculations. Behavioral Ecology 14:446-450.
14. Dayton, P.K. 1998. Reversal of the burden of proof in fisheries management. Science 279:821-822.
15. de la Mare, W.K. 1984. On the power of catch per unit effort series to detect declines in whale stocks. Reports of the International Whaling Commission 34:655-662.
16. Dixon, P.M., and J.H.K. Pechmann. 2005. A statistical test to show negligible trend. Ecology 86:1751-1756.
17. Dorazio, R.M., and F.A. Johnson. 2003. Bayesian inference and decision theory - a framework for decision-making in natural resource management. Ecological Applications 13:556-563.
18. Earll, R.C. 1992. Commonsense and the precautionary principle - an environmentalist's perspective. Marine Pollution Bulletin 24:182-186.
19. Eberhardt, L.L. 2003. What should we do about hypothesis testing? Journal of Wildlife Management 67:241-247.
20. Ellison, A.M. 1996. An introduction to Bayesian inference for ecological research and environmental decision-making. Ecological Applications 6:1036-1046.
21. Field, S.A., A.J. Tyre, N. Jonzen, J.R. Rhodes, and H.P. Possingham. 2004. Minimizing the cost of environmental management decisions by optimizing statistical thresholds. Ecology Letters 7:669-675.
22. Field, S.A., A.J. Tyre, and H.P. Possingham. 2005. Optimizing allocation of monitoring effort under economic and observational constraints. Journal of Wildlife Management 69:473-482.
23. Fisher, R.A. 1955. Statistical methods and scientific induction. Journal of the Royal Statistical Society, Series B 17:69-78.
24. Fox, D.R. 2001. Environmental power analysis - a new perspective. Environmetrics 12:437-449.
25. Gerard, P.D., D.R. Smith, and G. Weerakkody. 1998. Limits of retrospective power analysis. Journal of Wildlife Management 62:801-807.
26. Gibbs, J.P., S. Droege, and P. Eagle. 1998. Monitoring populations of plants and animals. BioScience 48:935-940.
27. Gigerenzer, G., Z. Swijtink, T. Porter, L.J. Daston, J. Beatty, and L. Kruger. 1989. The Empire of Chance: How Probability Changed Science and Everyday Life. Cambridge University Press, Cambridge, U.K.
28. Goodman, S.N., and J.A. Berlin. 1994. The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results. Annals of Internal Medicine 121:200-206.
29. Gray, J.S. 1990. Statistics and the precautionary principle. Marine Pollution Bulletin 21:174-176.
30. Greenland, S. 1988. On sample-size and power calculations for studies using confidence intervals. American Journal of Epidemiology 128:231-237.
31. Guthery, F.S., J.J. Lusk, and M.J. Peterson. 2001. The fall of the null hypothesis: liabilities and opportunities. Journal of Wildlife Management 65:379-384.
32. Guttman, L. 1985. The illogic of statistical inference for cumulative science. Applied Stochastic Models and Data Analysis 1:3-10.
33. Hauck, W.W., and S. Anderson. 1996. Comment-Bioequivalence trials, intersection-union tests and equivalence confidence sets. Statistical Science 11:303.
34. Hayes, J.P., and R.J. Steidl. 1997. Statistical power analysis and amphibian population trends. Conservation Biology 11:273-275.
35. Hoenig, J.M., and D.M. Heisey. 2001. The abuse of power: the pervasive fallacy of power calculations for data analysis. The American Statistician 55:19-24.
36. Hurlbert, S.H. 1984. Pseudoreplication and the design of ecological field experiments. Ecological monographs 54:187-211.
37. Jennions, M.D., and A.P. Moller. 2003. A survey of the statistical power of research in behavioral ecology and animal behavior. Behavioral Ecology 14:438-445.
38. Johnson, D.H. 1999. The insignificance of statistical significance testing. Journal of Wildlife Management 63:763-772.
39. Johnston, P., and M. Simmonds. 1990. Precautionary principle. Marine Pollution Bulletin 21:402.
40. Kirk, R.E. 1996. Practical significance: a concept whose time has come. Educational and Psychological Measurement 56:746-759.
41. Lenth, R.V. 2001. Some practical guidelines for effective sample size determination. The American Statistician 55:187-193.
42. Leventhal, L., and C. Huynh. 1996. Directional decisions for two-tailed tests: power, error rates, and sample size. Psychological Methods 1:278-292.
43. Lindley, S.T., M.S. Mohr, and M.H. Prager. 2000. Monitoring protocol for Sacramento River winter Chinook salmon, Oncorhynchus tshawytscha, application of statistical power analysis to recovery of an endangered species. Fishery Bulletin 98:759-766.
44. Mapstone, B.D. 1995. Scalable decision rules for environmental impact studies: effect size, Type I, and Type II errors. Ecological Applications 5:401-410.
45. McBride, G.B. 1999. Equivalence tests can enhance environmental science and management. Australian and New Zealand Journal of Statistics 41:19-29.
46. McBride, G.B., J.C. Loftis, and N.C. Adkins. 1993. What do significance tests really tell us about the environment? Environmental Management 17:423-432 .
47. Meeks, S.L., and R.B. D'Agostino. 1983. A note on the use of confidence limits following rejection of a null hypothesis. The American Statistician 37:134-136.
48. Murphy, K.R., and B. Myors. 2004. Statistical Power Analysis: a Simple and General Model for Traditional and Modern Hypothesis Tests. Lawrence Erlbaum, Mahwah, N.J.
49. Nakagawa, S., and T.M. Foster. 2004. The case against retrospective power analyses with an introduction to power analysis. Acta Ethologica 7:103-108.
50. Neyman, J., and E.S. Pearson. 1967. Joint Statistical Papers. University of California Press, Berkeley.
51. Nickerson, R.S. 2000. Null hypothesis significance testing: a review of an old and continuing controversy. Psychological Methods 5:241-301.
52. Oakes, M. 1990. Statistical Inference. Epidemiology Resources, Chestnut Hill, Mass.
53. Olsen, T., B.P. Hayden, A.M. Ellison, G.W. Oehlert, and S.R. Esterby. 1997. Ecological resource monitoring: change and trend detection workshop report. Bulletin of the Ecological Society of America 78:11-13.
54. Ortiz, M. 2002. Optimum sample size to detect perturbation effects: the importance of statistical power analysis - a critique. Marine Ecology 23:1-9.
55. Parkhurst, D.F. 2001. Statistical significance tests: equivalence and reverse tests should reduce misinterpretation. BioScience 15:1051-1057.
56. Peterman, R.M. 1990a. Statistical power analysis can improve fisheries research and management. Canadian Journal of Fisheries and Aquatic Science 47:2-15.
57. Peterman, R.M. 1990b. The importance of reporting statistical power: the forest decline and acidic deposition example. Ecology 71:2024-2027.
58. Peterman, R.M., and M.J. Bradford. 1987. Statistical power of trends in fish abundance. Canadian Journal of Fisheries and Aquatic Science 44:1879-1889.
59. Peterman, R.M., and M. M'Gonigle. 1992. Statistical power analysis and the precautionary principle. Marine Pollution Bulletin 24:231-234.
60. Platt, J.R. 1964. Strong inference. Science 146:347-353.
61. Poole, C. 2001. Low P-values or narrow confidence intervals: which are more durable? Epidemiology 12:291-294.
62. Popper, K.R. 1959. The Logic of Scientific Discovery. Basic Books, New York.
63. Reed, J.M., and A.R. Blaustein. 1997. Biologically significant population declines and statistical power. Conservation Biology 11:281-282.
64. Robinson, D.H., and H. Wainer. 2002. On the past and future of null hypothesis significance testing. Journal of Wildlife Management 66:263-271.
65. Rotenberry, J.T., and J.A. Wiens. 1985. Statistical power analysis and community-wide patterns. American Naturalist 125:164-168.
66. Sedlmeier, P., and G. Gigerenzer. 1989. Do studies of statistical power have an effect on the power of studies? Psychological Bulletin 105:309-316.
67. Shaver, J.P. 1993. What statistical significance testing is, and what it is not. Journal of Experimental Education 61:293-316.
68. Shrader-Frechette, K.S., and E.D. McCoy. 1992. Statistics, costs and rationality in ecological inference: Trends in Ecology and Evolution 7:96-99.
69. Simberloff, D. 1990. Hypotheses, errors, and statistical assumptions. Herpetologica 46:351-357.
70. Stefano, J.D. 2001. Power analysis and sustainable forest management. Forest Ecology and Management 154:141-153.
71. Stefano, J.D. 2003. How much power is enough? Against the development of an arbitrary convention for statistical power calculations. Functional Ecology 17:707-709.
72. Steidl, R.J., J.P., Hayes, and E. Schauber. 1997. Statistical power analysis in wildlife research. Journal of Wildlife Research 61:270-279.
73. Steiger, J.H. 2004. Beyond the F test: effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods 9:164-182.
74. Stoehr, A.M. 1999. Are significance thresholds appropriate for the study of animal behaviour? Animal Behaviour 57:F22-F25.
75. Suter, G.W.I. 1996. Abuse of hypothesis testing statistics in ecological risk assessment. Human and Ecological Risk Assessment 2:331-347.
76. Taylor, B.L., and T. Gerrodette. 1993. The uses of statistical power in conservation biology: the Vaquita and Northern Spotted Owl, Conservation Biology 7:489-500.
77. Taylor, D.J., and K.E. Muller. 1995. Computing confidence bounds for power and sample size of the general linear univariate model. The American Statistician 49:43-47.
78. Thomas, L. 1997. Retrospective power analysis. Conservation Biology 11:276-280.
79. Thomas, L., and F. Juanes. 1996. The importance of statistical power analysis: an example from Animal Behaviour. Animal Behaviour 52:856-859.
80. Thomas, L., and C.J. Krebs. 1997. A review of statistical power analysis software. Bulletin of the Ecological Society of America 78:126-139.
81. Toft, C.A., and P.J. Shea. 1983. Detecting community-wide patterns: estimating power strengthens statistical inference. American Naturalist 122:618-625.
82. Utts, J. 1988. Successful replication verses statistical significance. The Journal of Parapsychology 52:305-320.
83. Wade, P.R. 2000. Bayesian methods in conservation biology. Conservation Biology 14:1308-1316.
84. Yoccoz, N.G. 1991. Use, overuse, and misuse of significance tests in evolutionary biology and ecology. Bulletin of the Ecological Society of America 72:106-111.
85. Zumbo, B.D., and A.M. Hubley. 1998. A note on misconceptions concerning prospective and retrospective power. The Statistician 47:385-388.