Entropy and the species accumulation curve: A novel entropy estimator via discovery rates of new species

Methods in Ecology and Evolution

Volumn 4, Issue 11, 2013, Pages 1091-1100

  Chao, Anne ^a   Wang, Y T ^a   Jost, Lou ^b  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^b Via a Runtun   (Ecuador)

Author keywords

Diversity; Good Turing frequency formula; Mutual information; Sample coverage; Shannon entropy; Species accumulation curve; Species discovery rate

Indexed keywords

EID: 84887174208     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/2041-210X.12108     Document Type: Article

References (50)

1. Basharin, G. (1959) On a statistical estimate for the entropy of a sequence of independent random variables. Theory of Probability and its Applications, 4, 333-336.
2. Beck, J. & Schwanghart, W. (2010) Comparing measures of species diversity from incomplete inventories: an update. Methods in Ecology and Evolution, 1, 38-44.
3. Blyth, C.R. (1959) Note on estimating information. The Annals of Mathematical Statistics, 30, 71-79.
4. Chao, A. (2005) Species estimation and applications. Encyclopedia of Statistical Sciences, Vol.12, (eds S. Kotz, N. Balakrishnan, C.B. Read & B. Vidakovic ), pp. 7907-7916. Wiley, New York.
5. Chao, A. & Jost, L. (2012) Coverage-based rarefaction and extrapolation: standardizing samples by completeness rather than size. Ecology, 93, 2533-2547.
6. Chao, A. & Shen, T.J. (2003) Nonparametric estimation of Shannon's index of diversity when there are unseen species. Environmental and Ecological Statistics, 10, 429-443.
7. Chao, A., Jost, L., Chiang, S.C., Jiang, Y.-H. & Chazdon, R. (2008) A Two-stage probabilistic approach to multiple-community similarity indices. Biometrics, 64, 1178-1186.
8. Chiu, C.-H., Jost, L. & Chao, A. (2013) Phylogenetic beta diversity, similarity, and differentiation measures based on Hill numbers. Ecological Monographs, doi: http://dx.doi.org/10.1890/12-0960.1.
9. Colwell, R.K., Chao, A., Gotelli, N.J., Lin, S.Y., Mao, C.X., Chazdon, R.L. & Longino, J.T. (2012) Models and estimators linking individual-based and sample-based rarefaction, extrapolation, and comparison of assemblage. Journal of Plant Ecology, 5, 3-21.
10. Fisher, R.A., Corbet, A.S. & Williams, C.B. (1943) The relation between the number of species and the number of individuals in a random sample of an animal population. Journal of Animal Ecology, 12, 42-58.
11. Good, I.J. (1953) The population frequencies of species and the estimation of population parameters. Biometrika, 40, 237-264.
12. Good, I.J. (2000) Turing's anticipation of empirical Bayes in connection with the cryptanalysis of the naval enigma. Journal of Statistical Computation and Simulation, 66, 101-111.
13. Gotelli, N.J. & Chao, A. (2013) Measuring and estimating species richness, species diversity, and biotic similarity from sampling data. The Encyclopedia of Biodiversity, 2nd edn (ed. S.A. Levin ), Elsevier, New York.
14. Grassberger, P. (2003) Entropy estimates from insufficient samplings. URL www.arxiv.org. arXiv:physics/0307138v2. Updated 2008.
15. Hausser, J. & Strimmer, K. (2009) Entropy inference and the James-Stein estimator, with application to nonlinear gene association networks. The Journal of Machine Learning Research, 10, 1469-1484.
16. Horn, H.S. (1966) Measurement of overlap in comparative ecological studies. American Naturalist, 100, 419-424.
17. Horvitz, D.G. & Thompson, D.J. (1952) A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47, 663-685.
18. Jaynes, E.T. (2003) Probability Theory: The Logic of Science. Cambridge University Press, Cambridge.
19. Jost, L. (2007) Partitioning diversity into independent alpha and beta components. Ecology, 88, 2427-2439.
20. Jost, L. (2010) The relation between evenness and diversity. Diversity, 2, 207-232.
21. Lande, R., DeVries, P.J. & Walla, T.R. (2000) When species accumulation curves intersect: implications for ranking diversity using small samples. Oikos, 89, 601-605.
22. Lewontin, R. (1972) The apportionment of human diversity. Evolutionary Biology, 6, 381-398.
23. MacArthur, R.H. (1955) Fluctuations of animal populations and a measure of community stability. Ecology, 36, 533-536.
24. MacArthur, R.H. (1957) On the relative abundances of bird species. Proceedings of National Academy of Science, 43, 193-295.
25. MacArthur, R.H. (1965) Patterns of species diversity. Biological Reviews, 40, 510-533.
26. Magurran, A.E. (2004) Measuring Biological Diversity. Blackwell, Oxford.
27. Mandelbrot, B. (1977) Fractals, Form, Chance and Dimension. Freeman, San Francisco.
28. Marcon, E., Hérault, B., Baraloto, C. & Lang, G. (2012) The decomposition of Shannon's entropy and a confidence interval for beta diversity. Oikos, 121, 516-522.
29. Margalef, R. (1958) Information theory in ecology. General Systems, 3, 36-71.
30. May, R.M. (1975) Patterns of species abundance and distribution. Ecology and Evolution of Communities (eds M.C. Cody & J.M. Diamond ), pp. 81-120. Belknap Press, Cambridge.
31. Miller, R.I. & Wiegert, R.G. (1989) Documenting completeness, species-area relations, and the species-abundance distribution of a regional flora. Ecology, 70, 16-22.
32. Montgomery-Smith, S. & Schürmann, T. (2007) Unbiased estimators for entropy and class number. Unpublished notes. URL http://www.math.missouri.edu/~stephen/preprints/class-novel2.pdf
33. Nemenman, I., Shafee, F. & Bialek, W. (2002) Entropy and inference, revisited. Advances in Neural Information Processing Systems, Vol. 14 (eds T.G. Dietterich, S. Becker & S.Z. Ghahramani ), MIT Press, Cambridge.
34. O'Hara, R.B. (2005) Species richness estimators: how many species can dance on the head of a pin? Journal of Animal Ecology, 74, 375-386.
35. Olszewski, T.D. (2004) A unified mathematical framework for the measurement of richness and evenness within and among multiple communities. Oikos, 104, 377-387.
36. Paninski, L. (2003) Estimation of entropy and mutual information. Neural Computation, 15, 1191-1253.
37. Peet, R.K. (1974) The measurement of species diversity. Annual Review of Ecology and Systematics, 5, 285-307.
38. Pfeiffer, M. & Mezger, D. (2012) Biodiversity assessment in incomplete inventories: leaf litter ant communities in several types of Bornean rain forest. PLoS ONE, 7, e40729.
39. Pielou, E.C. (1977) Mathematical Ecology. John Wiley, New York.
40. Ricotta, C. (2003) On parametric evenness measures. Journal of Theoretical Biology, 222, 189-197.
41. Shannon, C.E. (1948) The mathematical theory of communication. Bell System Technical Journal, 27, 379-423.
42. Sherwin, W.B. (2010) Entropy and information approaches to genetic diversity and its expression: genomic geography. Entropy, 12, 1765-1798.
43. Sherwin, W.B., Jabot, F., Rush, R. & Rossetto, M. (2006) Measurement of biological information with applications from genes to landscapes. Molecular Ecology, 15, 2857-2869.
44. Ulanowicz, R.E. (2001) Information theory in ecology. Computers and Chemistry, 25, 393-399.
45. Victor, J.D. (2006) Approaches to information-theoretic analysis of neural activity. Biological Theory, 1, 302-316.
46. Vinck, M., Battaglia, F.P., Balakirsky, V.B., Vinck, A.J.H. & Pennartz, C.M.A. (2012) Estimation of the entropy based on its polynomial representation. Physical Review E, 85, 051139.
47. Vu, V.Q., Yu, B. & Kass, R.E. (2007) Coverage-adjusted entropy estimation. Statistics in Medicine, 26, 4039-4060.
48. Zahl, S. (1977) Jackknifing an index of diversity. Ecology, 58, 907-913.
49. Zhang, Z. (2012) Entropy estimation in Turing's perspective. Neural Computation, 24, 1368-1389.
50. Zipf, G.K. (1965) Human Behavior and Principle of Least Effort. Addison-Wesley, New York.