Efficient Adaptive Learning for Classification Tasks with Binary Units

Neural Computation

Volumn 10, Issue 4, 1998, Pages 1007-1030

  Torres Moreno, J Manuel ^a   Gordon, Mirta B ^a  

^a CEA GRENOBLE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; LEARNING; REPRODUCIBILITY; STATISTICAL ANALYSIS;

ALGORITHMS; CLASSIFICATION; DATA INTERPRETATION, STATISTICAL; LEARNING; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS;

EID: 0032523459     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976698300017601     Document Type: Article

References (43)

1. Alpaydin, E. A. I. (1990). Neural models of supervised and unsupervised learning. Unpublished doctoral dissertation, Ecole Polytechnique Fédérale de Lausanne, Switzerland.
2. Biehl, M., & Opper, M. (1991). Tilinglike learning in the parity machine. Physical Review A, 44, 6888.
3. Bottou, L., & Vapnik, V. (1992). Local learning algorithms. Neural Computation, 4(6), 888-900.
4. Breiman, L. (1994). Bagging predictors (Tech. Rep. No. 421). Berkeley: Department of Statistics, University of California at Berkeley.
5. Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and regression trees. Monterey, CA: Wadsworth and Brooks/Cole.
6. Denker, J., Schwartz, D., Wittner, B., Solla, S., Howard, R., Jackel, L., & Hopfield, J. (1987). Large automatic learning, rule extraction, and generalization. Complex Systems, 1, 877-922.
7. Depenau, J. (1995). Automated design of neural network architecture for classification. Unpublished doctoral dissertation, Computer Science Department, Aarhus University.
8. Drucker, H., Schapire, R., & Simard, P. (1993). Improving performance in neural networks using a boosting algorithm. In S. J. Hanson, J. D. Cowan, & C. L. Giles (Eds.), Advances in neural information processing systems, 5 (pp. 42-49). San Mateo, CA: Morgan Kaufmann.
9. Fahlman, S. E., & Lebiere, C. (1990). The cascade-correlation learning architecture. In D. S. Touretzky (Ed.), Advances in neural information processing systems, 2 (pp. 524-532). San Mateo: Morgan Kaufmann.
10. Farrell, K. R., & Mammone, R. J. (1994). Speaker recognition using neural tree networks. In J. D. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in Neural Information Processing Systems, 6 (pp. 1035-1042). San Mateo, CA: Morgan Kaufmann.
11. Frean, M. (1990). The Upstart algorithm: A method for constructing and training feedforward neural networks. Neural Computation, 2(2), 198-209.
12. Frean, M. (1992). A "thermal" perceptronlearning rule. Neural Computation, 4(6), 946-957.
13. Friedman, J. H. (1996). On bias, variance, 0/1-loss, and the curse-of-dimensionality (Tech. Rep.) Stanford, CA: Department of Statistics, Stanford University.
14. Fritzke, B. (1994). Supervised learning with growing cell structures. In J. D. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information processing systems, 6 (pp. 255-262). San Mateo, CA: Morgan Kaufmann.
15. Gallant, S. I. (1986). Optimal linear discriminants. In Proc. 8th. Conf. Pattern Recognition, Oct. 28-31, Paris, vol. 4.
16. Gascuel, O. (1995). Symenu. Collective Paper (Gascuel O. Coordinator) (Tech. Rep.). 5èmes Journées Nationales du PRC-IA Teknea, Nancy.
17. Geman, S., Bienenstock, E., & Doursat, R. (1992). Neural networks and the bias/variance dilemma. Neural Computation, 4(1), 1-58.
18. Goodman, R. M., Smyth, P., Higgins, C. M., & Miller, J. W. (1992). Rule-based neural networks for classification and probability estimation. Neural Computation, 4(6), 781-804.
19. Gordon, M. B. (1996). A convergence theorem for incremental learning with real-valued inputs. In IEEE International Conference on Neural Networks, pp. 381-386.
20. Gordon, M. B., & Berchier, D. (1993). Minimerror: A perceptron learning rule that finds the optimal weights. In M. Verleysen (Ed.), European Symposium on Artificial Neural Networks (pp. 105-110). Brussels: D Facto.
21. Gordon, M. B., & Grempel, D. (1995). Optimal learning with a temperature dependent algorithm. Europhysics Letters, 29(3), 257-262.
22. Gordon, M. B., Peretto, P., & Berchier, D. (1993). Learning algorithms for perceptrons from statistical physics. Journal of Physics I (France), 3, 377-387.
23. Gorman, R. P., & Sejnowski, T. J. (1988). Analysis of hidden units in a layered network trained to classify sonar targets. Neural Networks, 1, 75-89.
24. Gyorgyi, G., & Tishby, N. (1990). Statistical theory of learning a rule. In W. K. Theumann & R. Koeberle (Eds.), Neural networks and spin glasses. Singapore: World Scientific.
25. Hoehfeld, M., & Fahlman, S. (1991). Learning with limited numerical precision using the cascade correlation algorithm (Tech. Rep. No. CMU-CS-91-130). Pittsburgh: Carnegie Mellon University.
26. Knerr, S., Personnaz, L., & Dreyfus, G. (1990). Single-layer learning revisited: A stepwise procedure for building and training a neural network. In J. Hérault & F. Fogelman (Eds.), Neurocomputing, algorithms, architectures and applications (pp. 41-50). Berlin: Springer-Verlag.
27. Marchand, M., Golea, M., & Ruján, P. (1990). A convergence theorem for sequential learning in two-layer perceptrons. Europhysics Letters, 11, 487-492.
28. Martinez, D., & Estève, D. (1992). The offset algorithm: Building and learning method for multilayer neural networks. Europhysics Letters, 18, 95-100.
29. Mézard, M., & Nadal, J.-P. (1989). Learning in feedforward layered networks: The Tiling algorithm. J. Phys. A: Math. and Gen., 22, 2191-2203.
30. Mukhopadhyay, S., Roy, A., Kim, L. S., & Govil, S. (1993). A polynomial time algorithm for generating neural networks for pattern classification: Its stability properties and some test results. Neural Computation, 5(2), 317-330.
31. Nadal, J.-P. (1989). Study of a growth algorithm for a feedforward neural network. Int. J. Neur. Syst., 1, 55-59.
32. Prechelt, L. (1994). PROBEN1 - A set of benchmarks and benchmarking rules for neural network training algorithms (Tech. Rep. No. 21/94). University of Karlsruhe, Faculty of Informatics.
33. Raffin, B., & Gordon, M. B. (1995). Learning and generalization with Minimerror, a temperature dependent learning algorithm. Neural Computation, 7(6), 1206-1224.
34. Reilly, D. E, Cooper, L. N., & Elbaum, C. (1982). A neural model for category learning. Biological Cybernetics, 45, 35-41.
35. Roy, A., Kim, L., & Mukhopadhyay, S. (1993). A polynomial time algorithm for the construction and training of a class of multilayer perceptron. Neural Networks, 6(1), 535-545.
36. Sirat, J. A., & Nadal, J.-P. (1990). Neural trees: A new tool for classification. Network, 1, 423-438.
37. Solla, S. A. (1989). Learning and generalization in layered neural networks: The contiguity problem. In L. Personnaz & G. Dreyfus (Eds.), Neural Networks from Models to Applications. Paris: I.D.S.E.T.
38. Torres Moreno, J.-M., & Gordon, M. B. (1995). An evolutive architecture coupled with optimal perceptron learning for classification. In M. Verleysen (Ed.), European Symposium on Artificial Neural Networks. Brussels: D Facto.
39. Torres Moreno, J.-M., & Gordon, M. B. (1998). Characterization of the sonar signals benchmark. Neural Proc. Letters, 7(1), 1-4.
40. Trhun, S. B., et al. (1991). The monk's problems: A performance comparison of different learning algorithms (Tech. Rep. No. CMU-CS-91-197). Pittsburgh: Carnegie Mellon University.
41. Vapnik, V. (1992). Principles of risk minimization for learning theory. In J. E. Moody, S. J. Hanson, & R. P. Lippmann (Eds.), Advances in neural information processing systems, 4 (pp. 831-838). San Mateo, CA: Morgan Kaufmann.
42. Verma, B. K., & Mulawka, J. J. (1995). A new algorithm for feedforward neural networks. In M. Verleysen (Ed.), European Symposium on Artificial Neural Networks (pp. 359-364). Brussels: D Facto.
43. Wolberg, W. H., & Mangasarian, O. L. (1990). Multisurface method of pattern separation for medical diagnosis applied to breast cytology. In Proceedings of the National Academy of Sciences, USA, 87, 9193-9196.