Information conversion, effective samples, and parameter size

IEEE Transactions on Information Theory

Volumn 53, Issue 12, 2007, Pages 4438-4456

  Lin, Xiaodong ^a   Pittman, Jennifer ^b   Clarke, Bertrand ^c  

^a UNIVERSITY OF CINCINNATI   (United States)

^b DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Asymptotic relative efficiency; Number of parameters; Relative entropy; Sample size

Indexed keywords

ASYMPTOTIC RELATIVE EFFICIENCY; BAYESIAN HIERARCHICAL MODELS; CORRELATED DATUM; DATA SETS; EFFECTIVE PARAMETERS; FINITE MIXTURE MODELS; INDEPENDENCE MODELS; INFORMATION CONVERSIONS; NUISANCE PARAMETERS; NUMBER OF PARAMETERS; RELATIVE ENTROPY; SAMPLE SIZE; VIRTUAL SAMPLES;

ASYMPTOTIC ANALYSIS; HIERARCHICAL SYSTEMS;

ENTROPY;

EID: 64649091408     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2007.909168     Document Type: Article

References (35)

1. C. J. Adcock, "Sample size determination: A review," Statistician vol. 46, no. 2, pp. 261-283, 1997.
2. Affymetrix, Affymetrix Microarry Suite Guide, 5th ed. Santa Clara, CA, Affymetrix, 2001.
3. Affymetrix, Affymetrix Statistical Algorithms Description Document 5th ed. Santa Clara, CA, Affymetrix, 2002.
4. M. Benito, J. Parker, Q. Du, J.Wu, D. Xiang, C. Perou, and J. Marron, "Adjustment of systematic microarray data biases," Bioinformatics vol. 20, no. 1, pp. 105-114, 2004.
5. P. J. Bickel and J. A. Yahav, "Some contributions to the asymptotic theory of Bayes solutions," Z. Wahrsch. Verw. Geb., vol. 11, pp. 257-276, 1969.
6. L. Breimen, Probability. Reading, MA: Addison-Wesley, 1968.
7. K. C. Chanda, "A note on the consistency and maxima of the roots of the likelihood equations," Biometrika, vol. 41, pp. 56-61, 1954.
8. B. Clarke and A. R. Barron, Information Theoretic Asymptotics of Bayes Methods, Univ. Illinois at Urbana-Champaign, Dept. Statistics, 1989, Tech. Rep.26.
9. B. Clarke and A. R. Barrron, "Jeffrey's prior is asymptotically least favorable under entropic risk," J. Statist. Planning and Inference vol. 41, pp. 37-60, 1994.
10. B. Clarke, "Implications of reference priors for prior information and for sample size," J. Amer. Statist. Assoc., vol. 91, no. 433, pp. 173-184, 1996.
11. B. Clarke, "Asymptotic normality of the posterior in relative entropy," IEEE Trans. Inf. Theory, vol. 45, no. 1, pp. 165-176, Jan. 1999.
12. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
13. J. C. Deville and C. E. Sarndal, "Calibration estimators in survey sampling, J. Amer. Statist. Assoc., vol. 87, pp. 376-382, 1992.
14. T. Gneiting, F. Balabdaoui, and A. E. Raftery, Probabilistic Forecasts, Calibration and Sharpness. Dept. Statistics, Univ. Washington, Seattle, Tech. Rep., 2005.
15. D. Hoyle, M. Rattray, R. Jupp, and A. Brass, "Making sense of microarray data distributions," Bioinformatics, vol. 18, no. 4, pp. 576-584, 2002.
16. R. Irizarry, B. Hobbs, F. Collin, Y. Beazer-Barclay, K. Antonellis, U. Scherf, and T. Speed, "Exploration, normalization, and summaries of high density oligonucleotide array probe level data," Biostatistics vol. 4, pp. 249-264, 2003.
17. L. Joseph and P. Belisle, "Bayesian sample size determination for normal means and differences between normal means," Statistician, vol. 44, pp. 209-226, 1997.
18. S. M. Kakade and D. P. Foster, "Deterministic calibration and Nash equilibrium," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2004, vol. 3120, pp. 33-48.
19. R. G. Krutchkoff, "Classical and inverse methods of calibration," Technometrics, vol. 9, pp. 525-539, 1967.
20. S. Lee and M. Zelen, "Clinical trials and sample size considerations: Another perspective," Statist. Sci., vol. 15, no. 2, pp. 95-110, 2000.
21. C. Li and W. Wong, "Model-based analysis of oligonucleotide arrays: Expression index computation and outlier detection," PNAS, vol. 98, no. 1, pp. 31-36, 2001.
22. D. V. Lindley, "The choice of sample size," Statistician, vol. 46, pp. 129-138, 1997.
23. D. V. Lindley and A. F. M. Smith, "Bayes estimates for the linear model," J. Roy. Statist. Soc., Ser. B, vol. 34, pp. 1-41, 1972.
24. C. Osborne, "Statistical calibration: A review," Int. Statist.Rev. vol. 59, pp. 309-336, 1991.
25. G. Parmigiani, E. Garrett, R. Anbazhagan, and E. Gabrielson, "A cross-study comparison of gene expression data sets for the molecular classification of lung cancer," Clinical Cancer Res., vol. 10, pp. 2922-2927, 2004.
26. R. Redner, "Note on the consistency of the maximum likelihood estimate for non-identifiable distributions," Ann. Statist., vol. 9, pp. 225-288, 1981.
27. B. Rubinstein, J. McAuliffe, S. Cawley, M. Palaniswami, K. Ramamaohanarao, and T. Speed, "Machine learning in low-level microarray analysis," SIGKDD Explorations, vol. 5, no. 2, pp. 130-139, 2003.
28. V. K. Srivastava and N. Singh, "Small-disturbance asymptotic theory for linear-calibration estimators," Technometrics, vol. 31, pp. 373-378, 1989.
29. D. J. Spiegelhalter, N. G. Best, B. P. Clarion, and A. van der Linde, "Bayesian measures of model complexity and fit," J. Roy. Statist. Soc., Ser. B, vol. 64, pp. 583-640, 2002.
30. The Tumor Analysis Best Practices Working Group, "Expression profiling Best practices for data generation and interpretation in clinical trials," Nature Reviews Genetics, vol. 5, pp. 229-237, 2004.
31. A. Wald, "Note on the consistency of the maximum likelihood estimate," Ann. Math. Statist., vol. 20, pp. 595-601, 1949.
32. A. M. Walker, "On the asymptotic behaviour of posterior distributions," J. Roy. Statist. Soc., Ser. B, vol. 31, pp. 80-88, 1969.
33. J. Wolfowitz, "Asymptotic efficiency of the maximum likelihood estimator," Theory of Probab. and Applic., vol. 10, pp. 247-260, 1965.
34. Z. Wu, R. Irizarry, R. Gentleman, R. Murillo, and F. Spencer, Adjustment for Oligonucleotide Expression Arrays. Dept. Biostat., Johns Hopkins Univ., Baltimore, MD, 2003, Dept of Biostat Working Papers.
35. L. Zhang, M. Miles, and K. Aldape, "A model of molecular interactions on short oligonucleotide microarrays," Nature Biotechnol., vol. 21, no. 7, pp. 818-821, 2003.