Predicting the conditional probability of discovering a new class

Journal of the American Statistical Association

Volumn 99, Issue 468, 2004, Pages 1108-1118

  Mao, Chang Xuan ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Coverage; Nonparametric empirical Bayes; Poisson mixture

Indexed keywords

EID: 10844259784     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214504000001709     Document Type: Article

References (56)

1. Adams, M., Kelley, J., Gocayne, J. D.,et al. (1991), "Complementary DNA Sequencing: Expressed Sequence Tags and Human Genome Project," Science, 252, 1651-1656.
2. Audic, S., and Claverie, J. M. (1997), "The Significance of Digital Gene Expression Profiles," Genome Research, 1, 986-995.
3. Bailey, L. C., Searls, D. B., and Overton, G. C. (1998), "Analysis of EST-Driven Gene Annotation in Human Genome Sequence," Genome Research, 8, 362-370.
4. Banerjee, P. K., and Sinha, B. K. (1985), "Optimal and Adaptive Strategies in Discovering New Species," Sequential Analysis, 4, 111-122.
5. Baxevanis, A. D., and Ouellette, B. F. F. (eds.) (2001), A Practical Guide to the Analysis of Genes and Proteins, New York: Wiley.
6. Bickel, P., and Ritov, Y. (2003), "Nonparametric Estimators Which Can Be 'Plugged-in'," The Annals of Statistics, 31, 1033-1053.
7. Boguski, M S., Tolstoshev, C. M., and Basset, D. E. (1994), "Gene Discovery in dbEST," Science, 265, 1993-1994.
8. Bunge, J., and Fitzpatrick, M. (1993), "Estimating the Number of Species: A Review," Journal of the American Statistical Association, 88, 364-373.
9. Chao, A. (1981), "On Estimating the Probability of Discovering a New Species," The Annals of Statistics, 9, 1339-1342.
10. Chao, A., Hwang, W. H., Chen, Y. C., and Kuo, C. Y. (2000), "Estimating the Number of Shared Species in Two Communities," Statistica Sinica, 10, 227-246.
11. Chao, A., and Lee, S. M. (1992), "Estimating the Number of Classes via Sample Coverage," Journal of the American Statistical Association, 87, 210-217.
12. Clayton, M. K., and Frees, E. W. (1987), "Nonparametric Estimation of the Probability of Discovering a New Species," Journal of the American Statistical Association, 82, 305-311.
13. Cohen, A., and Sackrowitz, H. B. (1990), "Admissibility of Estimators of the Probability of Unobserved Outcomes," Annals of the Institute of Statistical Mathematics, 42, 623-636.
14. Craig, C. C. (1953), "On the Utilization of Marked Specimens in Estimating Populations of Flying Insects," Biomelrika, 40, 170-176.
15. Dahiya, R. C. (1974), "Estimation the Mean of the Selected Population," Journal of the American Statistical Association, 69, 226-230.
16. Deloukas, P., Schuler, G. D., Gyapay, G., et al. (1998), "A Physical Map of 30,000 Human Genes," Science, 282, 744-746.
17. Dempster, A. P., Laird, N. M., and Rubin, D, B. (1977), "Maximum Likelihood From Incomplete Data via the EM Algorithm," Journal of the Royal Statistical Society, Ser. B, 39, 1-22.
18. Efron, B. (2003), "Robbins, Empirical Bayes and Microarrays," The Annals of Statistics. 31, 366-378.
19. Efron, B., and Thisted, R. (1976), "Estimating the Number of Unseen Species: How Many Words Did Shakespeare Know?" Biometrika, 63, 435-447.
20. Esty, W. W. (1982), "Confidence Intervals for the Coverage of Low Coverage Samples," The Annals of Statistics, 10, 190-196.
21. _ (1983), "A Normal Limit Law for a Nonparametric Estimator of the Coverage of a Random Sample," The Annals of Statistics, 11, 905-911.
22. _ (1986), "The Efficiency of Good's Nonparametric Coverage Estimator," The Annals of Statistics, 14, 1257-1260.
23. Finch, S. J., Mendell, N. R., Henry, C., and Thode, J. (1989), "Probabilistic Measures of Adequacy of a Numerical Search for a Global Maximum," Journal of the American Statistical Association, 84, 1020-1023.
24. Fisher, R. A., Corbel, A. S., and Williams, C. B. (1943), "The Relation Between the Number of Species and the Number of Individuals in a Random Sample of an Animal Population," Journal of Animal Ecology, 12, 42-58.
25. Garg, K., Green, P., and Nickerson, D. A. (1999), "Identification of Candidate Code Region Single Nucleotide Polymorphism in 165 Human Genes Using Assembled Expressed Sequence Tags," Genome Research, 9, 1087-1092.
26. Good, I. J. (1953), "The Population Frequencies of Species and the Estimation of Population Parameters," Biometrika, 40, 237-264.
27. Good, I. J., and Toulmin, G. H. (1956), "The Number of New Species, and the Increase in Population Coverage, When a Sample Is Increased," Biometrika, 43, 45-63.
28. Harris, B. (1959), "Determining Bounds on Integrals With Applications to Cataloging Problems," The Annals of Mathematical Statistics, 30, 521-548.
29. Hill, B. M., and Woodroofe, M. (1975), "Stronger Forms of Zipf's Law," Journal of the American Statistical Association, 70, 212-219.
30. Hughes, J. B., Hellmann, J. J., Ricketts, T. H., and Bohannan, B. J. M. (2001), "Counting the Uncountable: Statistical Approaches to Estimating Microbial Diversity," Applied and Environmental Microbiology, 67, 4399-4406.
31. Keating, K. A., Quinn, J. F., Ivie, M., and Ivie, L. L. (1998), "Estimating the Effectiveness of Further Sampling in Species Inventories," Ecological Applications, 8, 1239-1249.
32. Keener, R., Rothman, E., and Starr, N. (1987), "Distributions on Partitions," The Annals of Statistics, 15, 1466-1481.
33. Knott, M. (1967), "Models for Cataloging Problems," The Annals of Mathematical Statistics, 38, 1255-1260.
34. Lindsay, B. G. (1983a), "The Geometry of Mixture Likelihoods: A General Theory," The Annals of Statistics, 11, 86-94.
35. _ (1983b), "The Geometry of Mixture Likelihoods, Part II: The Exponential Family," The Annals of Statistics, 11, 783-792.
36. _ (1995), Mixture Models: Theory; Geometry and Applications, Hayward, CA: Institute of Mathematical Statistics.
37. Lindsay, B. G., and Roeder, K. (1993), "Uniqueness and Identifiability," Canadian Journal of Statistics, 21, 226-233.
38. Lo, S. H. (1992), "From the Species Problem to a General Coverage Problem via a New Interpretation," The Annals of Statistics, 20, 1094-1109.
39. Mao, C. X., and Lindsay, B. G. (2002), "A Poisson Model for Coverage Problem With an Application in Genomic Research," Biometrika. 89, 669-681.
40. _ (2003), "Estimating the Number of Classes: Identin'ability, Singularity and One-Sided Inference," technical report, University of California, Riverside.
41. Nayak, T. K. (1996), "On Estimating the Conditional Probability of Discovering a New Species," Communications in Statistics, Part A - Theory and Methods, 25, 2039-2056.
42. _ (2000), "On Best Unbiased Prediction and Its Relationships to Unbiased Estimation," Journal of Statistical Planning and Inference, 84, 171-189.
43. Nicoleris, T., and Sagris, A. (2002), "Random Function Prediction and Stein's Identity," Statistics and Probability Letters, 59, 293-305.
44. Norris, J. L. I., and Pollock, K. H. (1998), "Non-Parametric MLE for Poisson Species Abundance Models Allowing for Heterogeneity Between Species," Environmental and Ecological Statistics, 5, 391-402.
45. Paster, B. J., Boches, S. K., Galvin, J. L., et al. (2001), "Bacterial Diversity in Human Subgingival Plaque," Journal of Bacteriology, 183, 3770-3783.
46. Quackenbush, J., Cho, J., Lee, D., et al. (2000), "The TIGR Gene Indices: Analysis of Gene Transcript Sequences in Highly Sampled Eukaryotic Species," Nucleic Acids Research, 29, 159-164.
47. Rasmussen, S. L., and Norman, S. (1979), "Optimal and Adaptive Stopping in the Search for New Species," Journal of the American Statistical Association, 74, 661-667.
48. Robbins, H. (1956), "An Empirical Bayes Approach to Statistics," Proceedings of the Third Berkeley Sympossium on Mathematical Statistics and Probability, 1, 157-163.
49. _ (1968), "Estimating the Total Probability of the Unobserved Outcomes of an Experiment," Annals of Mathematical Statistics, 39, 256-257.
50. Smith, W., and Grassle, J. F. (1977), "Sampling Properties of a Family of Diversity Measures," Biometrics, 33, 283-292.
51. Starr, N. (1979), "Linear Estimation of the Probability of Discovering a New Species," The Annals of Statistics, 7, 644-652.
52. Tierney, L., and Lambert, D. (1984), "Asymptotic Efficiency of Estimators of Functionals of Mixed Distributions," The Annals of Statistics, 12, 1380-1387.
53. Velculescu, V. E., Vogelstein, B., and Kinzler, K. W. (2000), "Analyzing Uncharted Transcriptomes With SAGE," Trends in Genetics, 16, 423-425.
54. Walther, B. A., and Martin, J. L. (2001), "Species Richness Estimation of Bird Communities: How to Control for Sampling Effort?" IBIS, 143, 413-419.
55. Yatracos, Y. G. (1992), "On Prediction and Mean Squared Error, " Canadian Journal of Statistics, 20, 187-200.
56. _ (1995), "On the Rare Species of a Population," Journal of Statistical Planning and Inference, 48, 321-329.