The Racing Algorithm: Model Selection for Lazy Learners

Artificial Intelligence Review

Volumn 11, Issue 1-5, 1997, Pages 193-225

  Maron, Oded ^a   Moore, Andrew W ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Attribute selection; Cross validation; Lazy learning; Model selection; Optimization

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SIMULATION; LEARNING SYSTEMS; OPTIMIZATION;

ATTRIBUTE SELECTION; CROSS VALIDATION; LAZY LEARNING; MODEL SELECTION; RACING ALGORITHM;

LEARNING ALGORITHMS;

EID: 0031069121     PISSN: 02692821     EISSN: None     Source Type: Journal    
DOI: 10.1007/978-94-017-2053-3_8     Document Type: Article

References (38)

1. Aha, D. W. (1990). A Study of Instance-Based Algorithms for Supervised Learning Tasks: Mathematical, Empirical and Psychological Evaluations. PhD. Thesis; Technical Report No. 90-42, University of California, Irvine.
2. Atkeson. C. G., Moore, A. W. & Schaal, S. A. (1997). Locally Weighted Learning. AI Review, this issue.
3. Atkeson, C. G. (1990). Memory-Based Approaches to Approximating Continuous Functions. In 1990 Workshop on Nonlinear Modeling and Forecasting. Adison-Wesley.
4. Bottou, L. & Vapnik, V. (1992). Local Learning Algorithms. Neural Computation 4: 888-900.
5. Box, G. E. P., Hunter, W. G. & and Hunter, J. S. (1978). Statistics for Experimenters. Wiley.
6. Caruana, R. A. & and Freitag, D. (1994). Greedy Attribute Selection. In Machine Learning: Proceedings of the Eleventh International Conference, pp. 28-36. Morgan Kaufmann.
7. Cleveland, W. S., Devlin, S. J. & Grosse, E. (1988). Regression by local fitting: Methods, properties, and computational algorithms. Journal of Econometrics 37: 87-114.
8. Conte, S. D. & De Boor, C. (1980). Elementary Numerical Analysis. McGraw Hill.
9. Dasarathy, B. V. (1991). Nearest Neighbor Norms: NN Patern Classifaction Techniques. IEEE Computer Society Press.
10. Efron, B. & Tibshirani, R. (1991). Statistical Data Analysis in the Computer Age. Science 253: 390-395.
11. Fix, E. & Hodges, J. L. (1951). Discriminatory Analysis: Nonparametric Discrimination: Consistency Properties. Project 21-49-004, Report Number 4, USAF School of Aviation Medicine.
12. Goldberg, D. (1989). Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley.
13. Gratch, J., Chien, S. & DeJong, G. (1993). Learning Search Control Knowledge for Deep Space Network Scheduling. In Proceedings of the 10th International Conference on Machine Learning, pp. 135-142. Morgan Kaufmann.
14. Gratch, J. (1994). An effective method for correlated selection problems. Department of Computer Science Technical Report Num. 1893, University of Illinois at Urbana-Champaign.
15. Greiner, R. & Jurisica, I. (1992). A statistical approach to solving the EBL utility problem. In Proceedings of the Tenth International conference on Artificial Intelligence, pp. 241-248. MIT Press.
16. Hastie, T. J. & Tibshirani, R. J. (1990). Generalized additive models. Chapman and Hall.
17. Haussler, D. (1992). Decision theoretic generalizations of the pac model for neural net and other learning applications. Information and Computation 100: 78-150.
18. Hoeffding, W. (1963). Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association 58: 13-30.
19. John, G. H., Kohavi, R. & Pfleger, K. (1994). Irrelevant features and the Subset Selection Problem. In Machine Learning: Proceedings of the Eleventh International Conference, pp. 121-129. Morgan Kaufmann.
20. Kaelbling, L. P. (1990). Learning in Embedded Systems. PhD. Thesis; Technical Report No. TR-90-04, Stanford University, Department of Computer Science.
21. Kreider, J. F. & Haberl, J. S. (1994). Predicting hourly building energy usage: The great energy predictor shootout - Overview and discussion of results. Transactions of the American Society of Heating, Refrigerating and Air-Conditioning Engineers, 100, Part 2.
22. Lowe, D. G. (1995). Similarity metric learning for a variable-kernel classifier. Neural Computation 7: 72-85.
23. Maron, O. & Moore, A. W. (1994). Hoeffding Races: Accelerating model selection search for classification and function approximation. In Cowan, J. D., Tesauro, G. & Alspector, J. (eds.), Advances in Neural Information Processing Systems 6. Morgan Kaufmann.
24. Maron, O. (1994). Hoeffding Races: Model Selection for MRI Classification. Masters Thesis, Dept. of Electrical Engeineering and Computer Science, M.I.T.
25. Miller, A. J. (1990). Subset Selection in Regression. Chapman and Hall.
26. Moore, A. W. & Lee, M. S. (1994). Efficient Algorithms for Minimizing Cross Validation Error. In Machine Learning: Proceedings of the Eleventh International Conference, pp. 190-198. Morgan Kaufmann.
27. Moore, A. W., Hill, D. J. & Johnson, M. P. (1992). An empirical investigation of brute force to choose features, smoothers and function approximators. In Hanson, S., Judd, S. & Petsche, T. (eds.), Computational Learning Theory and Natural Learning Systems, Volume 3. MIT Press.
28. Moore, A. W. (1992). Fast, robust adaptive control by learning only forward models. In Moody, J. E., Hanson, S. J. & Lippman, R. P. (eds.), Advances in Neural Information Processing Systems 4. Morgan Kaufmann.
29. Murphy, P. M. (1996). UCI repository of machine learning databases. For more information contact ml-repository@ics.uci.edu.
30. Omohundro, S. (1993). Private communication.
31. Press, W. H., Teukolsky, S. A., Vetterling, W. T. & Flannery, B. P. (1992). Numerical Recipes in C: the art of scientific computing. New York: Cambridge University Press, second edition.
32. Rivest, R. L. & Yin, Y. (1993). Simulation Results for a new two-armed bandit heuristic. Technical report, Laboratory for Computer Science, M.I.T.
33. Schaal, S. & Atkeson, C. G. (1993). Open loop stable control strategies for robot juggling. In Proceedings of IEEE conference on Robotics and Automation.
34. Schmitt, S. A. (1969). Measuring Uncertainty: An elementary introduction to Bayesian Statistics. Addison-Wesley.
35. Skalak, D. B. (1994). Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms. In Machine Learning: Proceedings of the Eleventh International Conference, pp. 293-301. Morgan Kaufmann.
36. Weiss, S. M. & Kulikowski, C. A. (1991). Computer systems that learn: Classification and prediction methods from statistics, neural nets, machine learning, and expert systems. San Mateo, CA: Morgan-Kaufmann.
37. Welch, B. L. (1937). The significance of the difference between two means when the population variances are unequal. Biometrika 29.
38. Zhang, X, Mesirov, J. P. & Waltz, D. L. (1992). Hybrid system for protein secondary structure prediction. Journal of Molecular Biology 225: 1049-1063.