Some results concerning off-training-set and IID error for the Gibbs and the Bayes optimal generalizers

Statistics and Computing

Volumn 8, Issue 1, 1998, Pages 35-54

  Wolpert, David H ^a   Knill, Emanuel ^b   Grossman, Tal ^c  

^a NASA AMES RESEARCH CENTER   (United States)

^b LOS ALAMOS NATIONAL LABORATORY   (United States)

^c LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

Bayes optimal; Gibbs; IID; Learning curves; Off training set; Supervised learning

Indexed keywords

EID: 0042725461     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1008867009312     Document Type: Article

References (24)

1. Bayarri, M. J. and Berger, J. O. Applications and limitations of robust Bayesian bounds and type II MLE, Purdue University Department of Statistics TR 93-11C.
2. Berger, J. (1985) Statistical Decision Theory and Bayesian Analysis. New York: Springer-Verlag.
3. Blumer, A. et al. (1987) Occam's Razor. Information Processing Letters, 24, 377-80.
4. Chaloner, K. and Verdinelli, I. Bayesian experimental design: a review. Minneapolis: University of Minnesota, Department of Statistics.
5. Cussens, J. A Bayesian analysis of algorithms for learning finite functions. Glasgow Caledonian University, Department of Mathematics.
6. Dietterich, T. (1990) Annual Review of Computer Science, 4, 255-306.
7. Gustafson, P. The local Sensitivity of posterior expectations. Carnegie Mellon University, Department of Statistics.
8. Haussler, D., Kearns, M. and Schapire, R. (1994) Machine Learning, 14, 83-115.
9. Hill, S. D. and Spall, J. C. (1994) Sensitivity of a Bayesian Analysis to the Prior Distribution. IEEE TSMC 24, 216-221.
10. Kearns, M. J. et al. (1992) Towards efficient agnostic learning. In Proceedings of the 5th Annual Workshop on Computational Learning Theory, ACM Press. New York.
11. Tom Mitchell (1994) Quote from Machine Learning course at Carnegie Mellon University Computer Science Department.
12. Opper, M. and Haussler, D. (1991a) In Proceedings of the 4th Annual Workshop on Computational Learning Theory, pp. 75-87, Morgan Kaufmann.
13. Opper, M. and Haussler, D. (1991b) Physics Review Letters, 66, 2677-80.
14. Parzen, E. (1960) Modern Probability Theory and its Applications. New York: Wiley.
15. Schwartz, D., Samalam, V., Solla, S. and Denker, J. (1990) Exhaustive Learning. Neural Computation, 2, 374-85.
16. Tishby, N., Levin, E. and Solla, S. (1989) In International Joint Conference on Neural Networks, Vol. II, pp. 403-9 IEEE.
17. van der Broeck, C. and Kawai, R. (1990) Physics Review A, 42, 6210-18 and in Proceedings of the International AMSE Conference on Neural Networks, San Diego (USA), May 1991, Vol. 1, pp. 151-62
18. van der Broeck, C. and Kawai, R. (1990) Physics Review A, 42, 6210-18 and in Proceedings of the International AMSE Conference on Neural Networks, San Diego (USA), May 1991, Vol. 1, pp. 151-62
19. Vapnik, V. (1992) Estimation of Dependences Based on Empirical Data, Springer-Verlag.
20. Weiss, S. M. and Kulikowski, C. A. (1991) Computer Systems that Learn. San Mateo, CA: Morgan Kauffman.
21. Wolpert, D. (1994a) In D. Wolpert (ed.) The Mathematics of Generalization, pp. 117-214, Addison-Wesley.
22. Wolpert, D (1994b) In S. Hanson et al. (eds) Neural Information Processing Systems 6. San Mateo, CA: Morgan-Kauffman.
23. Wolpert, D. and Lapedes, A. (1994) In D. Wolpert (ed.) The Mathematics of Generalization, pp. 243-78, Addison-Wesley.
24. Wolpert, D. Off-Training Set Error and a priori distinctions between Learning Algorithms, SFI TR 95-01-003.