Automatic Parameter Selection by Minimizing Estimated Error

Proceedings of the 12th International Conference on Machine Learning, ICML 1995

Volumn , Issue , 1995, Pages 304-312

  Kohavi, Ron ^a   John, George H ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; MACHINE LEARNING; PARAMETER ESTIMATION;

CROSS VALIDATION; DISCRETE FUNCTIONS; ESTIMATED ERROR; INDUCTION ALGORITHMS; OPTIMAL PERFORMANCE; PARAMETER SELECTION; PARAMETER-SETTING; PERFORMANCE; TRAINING DATA; WRAPPER METHODS;

LEARNING ALGORITHMS;

EID: 33747419508     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Brazdil, P., Gama, J. & Henery, B. (1994), Characterizing the applicability of classification algorithms using meta-level learning, in F. Bergadano h L. D. Raedt, eds, "Machine Learning: ECML- 94. European Conference on Machine Learning", Lectures Notes in Artificial Intelligence, Springer- Verlag, Catania,Italy, pp. 83-102.
2. Breiman, L., Friedman, J., Olshen, R. & Stone, C. (1984), Classification and Regression Trees, Chapman & Hall, New York.
3. Caruana, R. & Freitag, D. (1994), Greedy attribute selection, in Hirsh & Cohen (1994), pp. 28-37.
4. Casella, G. & Berger, R. L. (1990), Statistical Inference, Wadsworth & Brooks/Cole.
5. Craven, M. W. & Shavlik, J. W. (1993), Learning symbolic rules using artificial neural networks, in P. Utgoff, ed., "Proceedings of the Tenth International Conference on Machine Learning", Morgan Kaufmann, pp. 73-80.
6. Finnoff, W., Hergert, F. & Zimmerman, H. G. (1993), "Improving model selection by nonconvergent methods", Neural Networks 6(6), 771-783.
7. Gasser, T., Kneip, A. & Kohler, W. (1991), "A flexible and fast method for automatic smoothing", Journal of the American Statistical Association 86(415), 643-652.
8. Ginsberg, M. L. (1993), Essentials of Artificial Intelligence, Morgan Kaufmann.
9. Hirsh, H. & Cohen, W., eds (1994), Machine Learning: Proceedings of the Eleventh International Conference, Morgan Kaufmann.
10. Holte, R. C. (1993), "Very simple classification rules perform well on most commonly used datasets", Machine Learning 11(1), 63-90.
11. John, G. H. (1994), Cross-validated C4.5: Using error estimation for automatic parameter selection, Technical Report STAN-CS-TN-94-12, Computer Science Department, Stanford University. Available by anonymous ftp from starry.Stanford. EDU:pub/gj ohn/papers/cvc45.ps.
12. John, G., Kohavi, R. & Pfleger, K. (1994), Irrelevant features and the subset selection problem, in Hirsh & Cohen (1994), pp. 121-129. Available by anonymous ftp in starry.Stanford.EDU: pub/gj ohn/papers/relevance4.ps.
13. Kohavi, R. (1994), Feature subset selection as search with probabilistic estimates, in "A A AI Fall Symposium on Relevance". Available by anonymous ftp in starry.Stanford.EDU: pub/ronnyk/aaaiSymposium94.ps.
14. Kohavi, R. (1995a), The power of decision tables, in N. Lavrac & S. Wrobel, eds, "Machine Learning: ECML-95 (Proc. European Conf. on Machine Learning)", Spriner Verlag, pp. 174 - 189. Available by anonymous ftp from starry.Stanford.EDU:pub/ronnyk/tables.ps.
15. Kohavi, R. (19956), A study of cross-validation and bootstrap for accuracy estimation and model selection, in "Proceedings of the 14th International Joint Conference on Artificial Intelligence". Available by anonymous ftp from starry. Stanford .EDU:pub/ronnyk/accEst-long.ps.
16. Lang, K. J., Waibel, A. H. k Hinton, G. E. (1990), "A time-delay neural network architecture for isolated word recognition", Neural Networks 3, 23- 43.
17. Langley, P. & Sage, S. (1994), Induction of selective bayesian classifiers, in "Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence", Morgan Kaufmann, Seattle, WA, pp. 399-406.
18. Linhart, H. & Zucchini, W. (1986), Model Selection, Wiley.
19. Mangasarian, O. L. & Wolberg, W. H. (1990), "Cancer diagnosis via linear programming", SI AM News 23(5), 1,18.
20. Michie, D., Spiegelhalter, D. J. & Taylor, C. C. (1994), Machine Learning, Neural and Statistical Classification, Prentice Hall.
21. Mitchell, T. M. (1982), "Generalization as search", Artificial Intelligence 18, 203-266.
22. Moore, A. & Lee, M. (1994), Efficient algorithms for minimizing cross-validation error, in Hirsh & Cohen (1994), pp. 190-198.
23. Moore, A. W., Hill, D. J. & Johnson, M. P. (1992), An empirical investigation of brute force to choose features, smoothers and function approximators, in "Computational Learning Theory and Natural Learning Systems Conference".
24. Murphy, P. M. & Aha, D. W. (1994), "UCI repository of machine learning databases", Available by anonymous ftp to ics.uci.edu in the pub/machine- learning-databases directory.
25. Nilsson, N. (1980), Principles of Artificial Intelligence, Morgan Kaufmann.
26. Press, W. H., Teukolsky, S. A., Vetterling, W. T. & Flannery, B. P. (1992), Numerical Recipes in C: The Art of Scientific Computing, second edition, Cambridge University Press.
27. Quinlan, J. R. (1993), C4.5: Programs for Machine Learning, Morgan Kaufmann.
28. Scharfer, C. (1993), "Selecting a classification method by cross-validation", Machine Learning 13, 135- 143.
29. Schaffer, C. (1994), A conservation law for generalization performance, in Hirsh & Cohen (1994), pp. 259-267.
30. Stone, M. (1974), "Cross-validatory choice and assessment of statistical predictions", Journal of the Royal Statistical Society B 36, 111-147.
31. Thrun, S. B. et al. (1991), The monk's problems - a performance comparison of different learning algorithms, Technical Report CMU-CS-91-197, CMU School of Computer Science.
32. Utans, J. & Moody, J. (1991), Selecting neural network architectures via the prediction risk: Application to corporate bond rating prediction, in "The First International Conference on Artificial Intelligence Applications on Wall Street", IEEE Computer Society Press.
33. Wahba, G. (1990), Spline Functions for Observational Data, CBMS-NSF Regional Conference Series, SI AM, Philadelphia.
34. Weigend, A. S. (1994), On overfitting and the effective number of hidden units, in M. C. Mozer, P. Smolensky, D. S. Touretzky, J. L. Elman & A. S. Weigend, eds, "Proceedings of the 1993 Connectionist Models Summer School", Erlbaum Associates, Hillsdale, NJ, pp. 335-342.
35. Weiss, S. M. & Kulikowski, C. A. (1991), Computer Systems that Learn, Morgan Kaufmann, San Mateo, CA.
36. Wolpert, D. H. (1994), The relationship between PAC, the statistical physics framework, the Bayesian framework, and the VC framework, Technical report, The Santa Fe Institute, Santa Fe, NM.
37. Zwitter, M. & Soklic, M. (1994á), "Ljubljana breast cancer database", Available by anonymous ftp toics. uci. edu in the pub/machinelearning- databases directory.
38. Zwitter, M. & Soklic, M. (19946), "Lymphography database", Available by anonymous ftp to ics.uci.edu in the pub/machinelearning- databases directory.