Rarefaction and extrapolation with Hill numbers: A framework for sampling and estimation in species diversity studies

Ecological Monographs

Volumn 84, Issue 1, 2014, Pages 45-67

  Chao, Anne ^a   Gotelli, Nicholas J ^b   Hsieh, T C ^a   Sander, Elizabeth L ^b   Ma, K H ^a   Colwell, Robert K ^c,d   Ellison, Aaron M ^e  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^b UNIVERSITY OF VERMONT   (United States)

^c UNIVERSITY OF CONNECTICUT   (United States)

^d UNIVERSITY OF COLORADO   (United States)

^e HARVARD UNIVERSITY   (United States)

Author keywords

Abundance data; Diversity; Extrapolation; Hill numbers; Incidence data; Interpolation; Prediction; Rarefaction; Sample coverage; Species richness

Indexed keywords

BIODIVERSITY; BOOTSTRAPPING; ENTROPY; INTERPOLATION; PREDICTION; RELATIVE ABUNDANCE; SAMPLING; SPECIES DIVERSITY; SPECIES RICHNESS; TEMPERATE FOREST;

EID: 84893283120     PISSN: 00129615     EISSN: 15577015     Source Type: Journal    
DOI: 10.1890/13-0133.1     Document Type: Article

References (70)

1. Alroy, J. 2010. The shifting balance of diversity among major marine animal groups. Science 329:1191-1194.
2. Brook, B. W., N. S. Sodhi, and P. K. L. Ng. 2003. Catastrophic extinctions follow deforestation in Singapore. Nature 424:420-426.
3. Chao, A. 1984. Nonparametric estimation of the number of classes in a population. Scandinavian Journal of Statistics 11:265-270.
4. Chao, A. 1987. Estimating the population size for capturerecapture data with unequal catchability. Biometrics 43:783-791.
5. Chao, A., and C.-H. Chiu. 2013. Estimation of species richness and shared species richness. In N. Balakrishnan, editor. Handbook of methods and applications of statistics in the atmospheric and earth sciences. Wiley, New York, New York, USA, in press.
6. Chao, A., C.-H. Chiu, and L. Jost. 2010. Phylogenetic diversity measures based on Hill numbers. Philosophical Transactions of the Royal Society B 365:3599-3609.
7. Chao, A., and L. Jost. 2012. Coverage-based rarefaction and extrapolation: standardizing samples by completeness rather than size. Ecology 93:2533-2547.
8. Chao, A., and S.-M. Lee. 1992. Estimating the number of classes via sample coverage. Journal of the American Statistical Association 87:210-217.
9. Chao, A., Y. T. Wang, and L. Jost. 2013. Entropy and the species accumulation curve: a nearly unbiased estimator of entropy via discovery rates of new species. Methods in Ecology and Evolution, in press.
10. Chiu, C.-H., L. Jost, and A. Chao. 2014. Phylognetic beta diversity, similarity, and differentiation measures based on Hill numbers. Ecological Monographs 84:21-44.
11. Coleman, B. D., M. A. Mares, M. R. Willig, and Y. H. Hsieh. 1982. Randomness, area, and species richness. Ecology 63:1121-1133.
12. Colwell, R. 2013. EstimateS: Statistical estimation of species richness and shared species from samples. Version 9. http://purl.oclc.org/estimates
13. Colwell, R. K., A. Chao, N. J. Gotelli, S. Y. Lin, C. X. Mao, R. L. Chazdon, and J. T. Longino. 2012. Models and estimators linking individual-based and sample-based rarefaction, extrapolation and comparison of assemblages. Journal of Plant Ecology 5:3-21.
14. Colwell, R. K., and J. A. Coddington. 1994. Estimating terrestrial biodiversity through extrapolation. Philosophical Transactions of the Royal Society B 345:101-118.
15. Colwell, R. K., C. X. Mao, and J. Chang. 2004. Interpolating, extrapolating, and comparing incidence-based species accumulation curves. Ecology 85:2717-2727.
16. Connell, J. H. 1978. Diversity in tropical rain forests and coral reefs. Science 199:1302-1310.
17. Connolly, S. R., and M. Dornelas. 2011. Fitting and empirical evaluation of models for species abundance distributions. Pages 123-140 in A. E. Magurran and B. J. McGill, editors. Biological diversity: frontiers in measurement and assessment. Oxford University Press, New York, New York, USA.
18. Dauby, G., and O. J. Hardy. 2011. Sampled-based estimation of diversity sensu stricto by transforming Hurlbert diversities into effective number of species. Ecography 35:661-672.
19. Ellison, A. M., A. A. Barker-Plotkin, D. R. Foster, and D. A. Orwig. 2010. Experimentally testing the role of foundation species in forests: the Harvard Forest Hemlock Removal Experiment. Methods in Ecology and Evolution 1:168-179.
20. Esty, W. W. 1983. A normal limit law for a nonparametric estimator of the coverage of a random sample. Annals of Statistics 11:905-912.
21. Esty, W. W. 1986. The efficiency of Good's nonparametric coverage estimator. Annals of Statistics 14:1257-1260.
22. Fisher, R. A., A. S. Corbet, and C. B. Williams. 1943. The relation between the number of species and the number of individuals in a random sample of an animal population. Journal of Animal Ecology 12:42-58.
23. Gaston, K. J., and R. A. Fuller. 2008. Commonness, population depletion and conservation biology. Trends in Ecology and Evolution 23:14-19.
24. Ghent, A. W. 1991. Insights into diversity and niche breadth analyses from exact small-sample tests of the equal abundance hypothesis. American Midland Naturalist 126:213-255.
25. Good, I. J. 1953. The population frequencies of species and the estimation of population parameters. Biometrika 40:237-264.
26. Good, I. J. 2000. Turing's anticipation of empirical Bayes in connection with the cryptanalysis of the naval enigma. Journal of Statistical Computation and Simulation 66:101-111.
27. Good, I. J., and G. Toulmin. 1956. The number of new species, and the increase in population coverage, when a sample is increased. Biometrika 43:45-63.
28. Gotelli, N. J., and A. Chao. 2013. Measuring and estimating species richness, species diversity, and biotic similarity from sampling data. Pages 195-211 in S. A. Levin, editor. The encyclopedia of biodiversity. Second edition, volume 5. Academic Press, Waltham, Massachusetts, USA.
29. Gotelli, N. J., and R. K. Colwell. 2001. Quantifying biodiversity: procedures and pitfalls in the measurement and comparison of species richness. Ecology Letters 4:379-391.
30. Gotelli, N. J., and R. K. Colwell. 2011. Estimating species richness. Pages 39-54 in A. E. Magurran and B. J. McGill, editors. Biological diversity: frontiers in measurement and assessment. Oxford University Press, New York, New York, USA.
31. Gotelli, N. J., and A. M. Ellison. 2012. A primer of ecological statistics. Second edition. Sinauer Associates, Sunderland, Massachusetts, USA.
32. Groom, M. J., G. K. Meffe, and C. R. Carroll. 2005. Principles of conservation biology. Third edition. Sinauer Associates, Sunderland, Massachusetts, USA.
33. Hill, M. 1973. Diversity and evenness: a unifying notation and its consequences. Ecology 54:427-432.
34. Holsinger, K. E., and L. D. Gottlieb. 1991. Conservation of rare and endangered plants: principles and prospects. Pages 195-208 in D. A. Falk and K. E. Holsinger, editors. Genetics and conservation of rare plants. Oxford University Press, New York, New York, USA.
35. Hubbell, S. P. 2001. A unified theory of biodiversity and biogeography. Princeton University Press, Princeton, New Jersey, USA.
36. Hurlbert, S. H. 1971. The nonconcept of species diversity: a critique and alternative parameters. Ecology 52:577-586.
37. Jost, L. 2006. Entropy and diversity. Oikos 113:363-375.
38. Jost, L. 2007. Partitioning diversity into independent alpha and beta components. Ecology 88:2427-2439.
39. Jost, L. 2010. The relation between evenness and diversity. Diversity 2:207-232.
40. Longino, J. T., and R. K. Colwell. 2011. Density compensation, species composition, and richness of ants on a neotropical elevational gradient. Ecosphere 2:art29.
41. MacArthur, R. H. 1965. Patterns of species diversity. Biological Reviews 40:510-533.
42. MacArthur, R. H., and E. O. Wilson. 1967. The theory of island biogeography. Princeton University Press, Princeton, New Jersey, USA.
43. Magurran, A. E. 2004. Measuring biological diversity. Blackwell, Oxford, UK.
44. Magurran, A. E., and B. J. McGill, editors. 2011. Biological diversity: frontiers in measurement and assessment. Oxford University Press, Oxford, UK.
45. May, R. M. 1988. How many species are there on earth? Science 241:1441-1449.
46. Nielsen, R., D. Tarpy, and H. Reeve. 2003. Estimating effective paternity number in social insects and the effective number of alleles in a population. Molecular Ecology 12: 3157-3164.
47. Olszewski, T. D. 2004. A unified mathematical framework for the measurement of richness and evenness within and among multiple communities. Oikos 104:377-387.
48. Paninski, L. 2003. Estimation of entropy and mutual information. Neural Computation 15:1191-1253.
49. Patil, G. P., and C. Taillie. 1979. An overview of diversity. Pages 3-27 in J. F. Grassle, G. P. Patil, W. Smith, and C. Taillie, editors. Ecological diversity in theory and practice. International Cooperative, Fairfield, Maryland, USA.
50. Patil, G. P., and C. Taillie. 1982. Diversity as a concept and its measurement. Journal of the American Statistical Association 77:548-561.
51. Pielou, E. C. 1975. Ecological diversity. Wiley, New York, New York, USA.
52. Rasmussen, S. L., and N. Starr. 1979. Optimal and adaptive stopping in the search for new species. Journal of the American Statistical Association 74:661-667.
53. Ricotta, C. 2003. On parametric evenness measures. Journal of Theoretical Biology 222:189-197.
54. Ricotta, C., S. Pavoine, G. Bacaro, and A. T. R. Acosta. 2012. Functional rarefaction for species abundance data. Methods in Ecology and Evolution 3:519-525.
55. Robbins, H. E. 1968. Estimating the total probability of the unobserved outcomes of an experiment. Annals of Mathematical Statistics 39:256-257.
56. Ross, S. M. 1995. Stochastic processes. Wiley, New York, New York, USA.
57. Sackett, T. E., S. Record, S. Bewick, B. Baiser, N. J. Sanders, and A. M. Ellison. 2011. Response of macroarthropod assemblages to the loss of hemlock (Tsuga canadensis), a foundation species. Ecosphere 2:art74.
58. Sanders, H. L. 1968. Marine benthic diversity: a comparative study. American Naturalist 102:243-282.
59. Schenker, N., and J. F. Gentleman. 2001. On judging the significance of differences by examining the overlap between confidence intervals. American Statistician 55:182-186.
60. Schwartz, M. W., C. A. Brigham, J. D. Hoeksema, K. G. Lyons, M. H. Mills, and P. J. Van Mantgem. 2000. Linking biodiversity to ecosystem function: implications for conservation ecology. Oecologia 122:297-305.
61. Shen, T. J., A. Chao, and C. F. Lin. 2003. Predicting the number of new species in further taxonomic sampling. Ecology 84:798-804.
62. Simberloff, D. 1972. Properties of the rarefaction diversity measurement. American Naturalist 106:414-418.
63. Smith, W., and J. F. Grassle. 1977. Sampling properties of a family of diversity measures. Biometrics 33:283-292.
64. Soberón, M., and J. B. Llorente. 1993. The use of species accumulation functions for the prediction of species richness. Conservation Biology 7:480-488.
65. Terborgh, J., L. Lopez, P. Nunez, M. Rao, G. Shahabuddin, G. Orihuela, M. Riveros, R. Ascanio, G. H. Adler, and T. D. Lambert. 2001. Ecological meltdown in predator-free forest fragments. Science 294:1923-1926.
66. Tipper, J. C. 1979. Rarefaction and rarefiction-the use and abuse of a method in paleoecology. Paleobiology 5:423-434.
67. Tóthmérész, B. 1995. Comparison of different methods for diversity ordering. Journal of Vegetation Science 6:283-290.
68. Walker, S. C., M. S. Poos, and D. A. Jackson. 2008. Functional rarefaction: estimating functional diversity from field data. Oikos 117:286-296.
69. Washington, H. G. 1984. Diversity, biotic and similarity indices: a review with special relevance to aquatic ecosystems. Water Research 18:653-694.
70. Wiens, J. J., and M. J. Donoghue. 2004. Historical biogeography, ecology and species richness. Trends in Ecology and Evolution 19:639-644.