Active learning with statistical models

Journal of Artificial Intelligence Research

Volumn 4, Issue , 1996, Pages 129-145

  Cohn, David A ^a   Ghahramani, Zoubin ^a   Jordan, Michael I ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; FEEDFORWARD NEURAL NETWORKS; LEARNING SYSTEMS; MATHEMATICAL MODELS; REGRESSION ANALYSIS; STATISTICAL METHODS;

DATA SELECTION TECHNIQUES; TRAINING DATA;

LEARNING ALGORITHMS;

EID: 0029679131     PISSN: 10769757     EISSN: None     Source Type: Journal    
DOI: 10.1613/jair.295     Document Type: Article

References (28)

1. Angluin, D. (1988). Queries and concept learning. Machine Learning, 2, 319-342.
2. Baum, E., & Lang, K. (1991). Neural network algorithms that learn in polynomial time from examples and queries. IEEE Trans. Neural Networks, 2.
3. Box, G., & Draper, N. (1987). Empirical model-building and response surfaces. Wiley.
4. Cheeseman, P., Self, M., Kelly, J., Taylor, W., Freeman, D., & Stutz, J. (1988). Bayesian classification. In AAAI 88, The 7th National Conference on Artificial Intelligence, pp. 607-611. AAAI Press.
5. Cleveland, W., Devlin, S., & Grosse, E. (1988). Regression by local fitting. Journal of Econometrics, 37, 87-114.
6. Cohn, D. (1994). Neural network exploration using optimal experiment design. In Cowan, J., Tesauro, G., & Alspector, J. (Eds.), Advances in Neural Information Processing Systems 6. Morgan Kaufmann. Expanded version available as MIT AI Lab memo 1491 by anonymous ftp to publications.ai.mit.edu.
7. Cohn, D. (1995). Minimizing statistical bias with queries. AI Lab memo AIM-1552, Massachusetts Institute of Technology. Available by anonymous ftp from publications.ai.mit.edu.
8. Cohn, D., Atlas, L., & Ladner, R. (1990). Training connectionist networks with queries and selective sampling. In Touretzky, D. (Ed.), Advances in Neural Information Processing Systems 2. Morgan Kaufmann.
9. Cohn, D., Atlas, L., & Ladner, R. (1994). Improving generalization with active learning. Machine Learning, 5(2), 201-221.
10. Dempster, A., Laird, N., & Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. Royal Statistical Society Series B, 39, 1-38.
11. Fedorov, V. (1972). Theory of Optimal Experiments. Academic Press.
12. Fe'ldbaum, A. A. (1965). Optimal control systems. Academic Press, New York, NY.
13. Geman, S., Bienenstock, E., & Doursat, R. (1992). Neural networks and the bias/variance dilemma. Neural Computation, 4, 1-58.
14. Ghahramani, Z., & Jordan, M. (1994). Supervised learning from incomplete data via an EM approach. In Cowan, J., Tesauro, G., & Alspector, J. (Eds.), Advances in Neural Information Processing Systems 6. Morgan Kaufmann.
15. Heckerman, D., Geiger, D., & Chickering, D. (1994). Learning Bayesian networks: the combination of knowledge and statistical data. Tech report MSR-TR-94-09, Microsoft.
16. Linden, A., & Weber, F. (1993). Implementing inner drive by competence reflection. In Roitblat, H. (Ed.), Proceedings of the 2nd International Conference on Simulation of Adaptive Behavior. MIT Press, Cambridge, MA.
17. MacKay, D. J. (1992). Information-based objective functions for active data selection. Neural Computation, 4(4), 590-604.
18. Nowlan, S. (1991). Soft competitive adaptation: Neural network learning algorithms based on fitting statistical mixtures. Tech report CS-91-126, Carnegie Mellon University.
19. Paass, G., & Kindermann, J. (1995). Bayesian query construction for neural network models. In Tesauro, G., Touretzky, D., & Leen, T. (Eds.), Advances in Neural Information Processing Systems 7. MIT Press.
20. Pearl, J. (1988). Probablistic Reasoning in Intelligent Systems. Morgan Kaufmann.
21. Plutowski, M., & White, H. (1993). Selecting concise training sets from clean data. IEEE Transactions on Neural Networks, 4, 305-318.
22. Schaal, S., & Atkeson, C. (1994). Robot juggling: An implementation of memory-based learning. Control Systems, 14, 57-71.
23. Schmidhuber, J., & Storck, J. (1993). Reinforcement driven information acquisition in non-deterministic environments. Tech report, Fakultät für Informatik, Technische Universität München.
24. Specht, D. (1991). A general regression neural network. IEEE Trans. Neural Networks, 2(6), 568-576.
25. Thrun, S., & Möller, K. (1992). Active exploration in dynamic environments. In Moody, J., Hanson, S., & Lippmann, R. (Eds.), Advances in Neural Information Processing Systems 4. Morgan Kaufmann.
26. Titterington, D., Smith, A., & Makov, U. (1985). Statistical Analysis of Finite Mixture Distributions. Wiley.
27. Weisberg, S. (1985). Applied Linear Regression. Wiley.
28. Whitehead, S. (1991). A study of cooperative mechanisms for faster reinforcement learning. Technical report CS-365, University of Rochester, Rochester, NY.