Experience with selecting exemplars from clean data

Neural Networks

Volumn 9, Issue 2, 1996, Pages 273-294

  Plutowski, Mark ^a   Cottrell, Garrison ^b,c   White, Halbert ^b  

^a David Sarnoff Research Center   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

active exemplar selection; active learning; chaotic time series; Mackey Glass time series; neural networks; nonlinear regression; querying; stepwise regression

Indexed keywords

CHAOS THEORY; FRACTALS; LEARNING SYSTEMS; REGRESSION ANALYSIS; SAMPLING; TIME SERIES ANALYSIS;

ACTIVE EXEMPLAR SELECTION; ACTIVE LEARNING; CHAOTIC TIME SERIES; MACKEY-GLASS TIME SERIES; NONLINEAR REGRESSION; QUERYING; STEPWISE REGRESSION;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; LEARNING; PRIORITY JOURNAL;

EID: 0030111078     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/0893-6080(95)00099-2     Document Type: Article

References (27)

1. Abarbanel, H. D. I., Brown, R., Sidorowich, J. J., & Tsimring, Lev Sh. (1993). The analysis of observed chaotic data in physical systems. Reviews of Modern Physics, October.
2. Baum, E., & Haussler, D. (1989). What size network gives valid generalization? In D. Touretzky (Ed.), Advances in neural information processing systems 1. San Mateo, CA: Morgan Kaufmann.
3. Box, G., & Draper, N. (1987). Empirical model-building and response surfaces. New York: John Wiley.
4. Constandse, R., & Cottrell, G. (1995). Image compression using active selection of training examples. Working paper, Department of Computer Science and Engineering, UCSD, La Jolla, CA.
5. Cottrell, G., & Fu-Sheng Tsung (1993). Learning simple arithmetic procedures. Connection Science, 5, 37-58.
6. DeMers, D., & Cottrell, G. (1993). Non-linear dimensionality reduction. In C. L. Giles, S. J. Hanson, & J. D. Cowan (Eds.), Advances in neural information processing systems 5 (pp. 580-587). San Mateo, CA: Morgan Kaufmann.
7. Fedorov, V. V. (1972). Theory of optimal experiments. New York: Academic Press.
8. Kennel, M. B. (1994). Archive for nonlinear dynamics papers and programs: FTP to lyapunov.ucsd.edu, username "anonymous". E-mail contact: mbk@inls1.ucsd.edu. Institute for Nonlinear Science, University of California, San Diego.
9. Kennel, M. B., Brown, R., & Abarbanel, H. D. I. (1992). Determining embedding dimension for phase-space reconstruction using a geometrical construction. Physical Reviews A, 45(6), 3403.
10. Khuri, A. I., & Cornell, J. A. (1987). Response surfaces (designs and analyses). New York: Marcel Dekker.
11. Lapedes, A., & Farber, R. (1987). Nonlinear signal processing using neural networks. Prediction and system modelling. Los Alamos Technical Report LA-UR-87-2662.
12. Mackey, M. C., & Glass, L. (1977). Oscillation and chaos in physiological control systems. Science, 197, 287.
13. McCaffrey, D. F., & Gallant, A. R. (1994). Convergence rates for single hidden layer feedforward networks. Neural Networks, 7, 147-158.
14. Møller, M. (1993a). Supervised learning on large redundant training sets. International Journal of Neural Systems, 4(1), 15-25.
15. Møller, M. (1993b). Efficient training of feed-forward neural networks. Doctoral dissertation, Computer Science Department, Aarhus University, Ny Munkegada, Building 540. DK-8000 Aarhus C, Denmark.
16. Müller, H.-G. (1984). Optimal designs for nonparametric kernel regression. Statistics and Probability Letters, 2, 285-290.
17. Munro, P. W. (1992). Repeat until bored: A pattern selection strategy. In J. E. Moody, S. J. Hanson, & R. P. Lippman (Eds.), Advances in neural information processing systems 4 (pp. 1001-1008). San Mateo, CA: Morgan Kaufmann.
18. Myers, Raymond H., A. I. Khuri, & W. H. Carter, Jr. (1989). Response Surface Methodology: 1966-1988. Technometrics, 31, 2.
19. Plutowski, M. E. P. (1994). Selecting exemplars for neural network learning. Ph.D. thesis, Computer Science and Engineering Department, University of California, San Diego, La Jolla, CA.
20. Plutowski, M. E. P. (1995). Using active exemplar selection to digest a large database of cell images for breast cancer detection. Manuscript to be presented at the AAAI Fall Symposium on Active Learning.
21. Plutowski, M. E. P., & White, H. (1993). Selecting concise training sets from clean data. IEEE Transactions on Neural Networks, 3, 1.
22. Plutowski, M. E. P., Cottrell, G., & White, H. (1993). Learning Mackey-Glass from 25 examples, plus or minus 2. In C. L. Giles, S. J. Hanson, & J. D. Cowan (Eds.), Advances in neural information processing systems 5. San Mateo, CA: Morgan Kaufmann.
23. Plutowski, M. E. P., Sakata, S., & White, H. (1994). Cross-validation estimates IMSE. In C. L. Giles, S. J. Hanson, & J. D. Cowan (Eds.), Advances in neural information processing systems 6. San Mateo, CA: Morgan Kaufmann.
24. Press, W. H., Flannery, B. P., Teukolsky, S. A., & Vetterlieg, W. T. (1988). Numerical recipes in C. New York: Cambridge University Press.
25. Röebel, A. (1993). The dynamic pattern selection algorithm: effective training and controlled generalization of backpropagation neural networks. Technical Report 93/23, Department of Computer Science, Technical University of Berlin (subsets of this Report will also appear in the Proceedings of the International Conference on Neural Networks, 1994).
26. Rowat, P., Hsieh, I.-T., & Selverston, A. (1994). The PREPARATION: a computer workbench for investigating the properties of small network models. Biology Department 0357, University of California, San Diego La Jolla, CA 92093-0357. email: prowat@ucsd.edu, ihsieh@ucsd.edu, aselverston@ucsd.edu.
27. Sollich. P. (1994). Query construction, entropy, and generalization in neural network models. Physical Review E. (in press).