Efficient partition of learning data sets for neural network training

Neural Networks

Volumn 10, Issue 8, 1997, Pages 1361-1374

  Tetko, Igor V ^a,b   Villa, Alessandro E P ^b  

^a INSTITUTE OF BIOORGANIC CHEMISTRY AND PETROCHEMISTRY   (Ukraine)

^b UNIVERSITY OF LAUSANNE   (Switzerland)

Author keywords

Adaptive strategy; Network ensemble; Pattern selection; Supervised learning; Thalamo cortical processing; Unsupervised learning

Indexed keywords

ADAPTIVE ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

PATTERN SELECTION; THALAMOCORTICAL PROCESSING;

NEURAL NETWORKS;

ADAPTATION; ARTICLE; ARTIFICIAL NEURAL NETWORK; DATA ANALYSIS; INFORMATION PROCESSING; LEARNING; NERVE CELL NETWORK; PRIORITY JOURNAL; TRAINING;

EID: 0031277422     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00005-1     Document Type: Article

References (43)

1. Bentivoglio, M., Chen, S., Peng, Z.-C., Bertini, G., Ringstedt, T., & Persson, H. (1993). Thalamus, neurotrophins and their receptors. In D. Minciacchi, M. Molinari, G. Macchi & E. G. Jones (Eds.), Thalamic networks for relay and modulation (pp. 309-320). Oxford: Pergamon.
2. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Oxford University Press.
3. Bös, S. (1995). Avoiding overfitting by finite temperature learning and cross-validation. In F. Fogelman-Soulié, P. Gallinari (Eds.), ICANN'95, Vol. 2 (pp. 111-116). Paris: EC2.
4. Breiman L. Bagging predictors. Machine Learning. 24:1996;123-140.
5. Breiman, L. (1996b). Bias, variance, and arcing classifiers (TR 460). Berkeley, CA: University of California, Dept. of Statistics.
6. Cachin C. Pedagogical pattern selection strategies. Neural Networks. 7:1994;175-181.
7. Crick F. Function of the thalamic reticular complex: the searchlight hypothesis. Proceedings of the National Academy of Sciences USA. 81:1984;4586-4590.
8. Hansen L. K., Salamon P. Neural networks ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence. 12:1990;993-1001.
9. Hecht-Nielsen, R. (1987). Kolmogorov's mapping neural network existence theorem. In Proceedings of the International Conference on Neural Networks (pp. 11-14). New York: IEEE Press.
10. IMSL (1987). IMSL math/library users manual. Houston: IMSL.
11. Jones, E. G. (1985). The thalamus. New York: Plenum.
12. Jung G., Opper M. Selection of examples for a linear classifier. Journal of Physics A: Mathematical and General. 29:1996;1367-1380.
13. Kohonen, T. (1989). Self-organisation and associate memory. Berlin: Springer.
14. Kolmogorov A. N. On the representations of continuous functions of many variables by superposition of continuous functions of one variable and addition. Dokl. Akad. Nauk USSR. 114:1957;953-956.
15. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., & Jackel, L. (1990). Handwritten digit recognition with a backpropagation network. In NIPS*2, D. S. Touretzky (Ed.) (pp. 396-404). San Mateo, CA: Morgan Kaufmann.
16. Levi Montalcini R., Calissano P. Nerve growth factor as a paradigm for other polypeptide growth factors. Trends in Neuroscience. 9:1986;473-477.
17. MacKay D. J. C. A practical Bayesian framework for backpropagation networks. Neural Computation. 4:1992;448-472.
18. McCormick D. A., Bal T. Sensory gating mechanisms of the thalamus. Current Opinion in Neurobiology. 4:1994;550-556.
19. McMullen N. T., de Venecia R. K. Thalamocortical patches in auditory neocortex. Brain Research. 620:1993;317-322.
20. Miller J., Riehle A., Requin J. Effects of preliminary perceptual output on neuronal activity of the primary cortex. Journal of Experimental Psychology: Human Perception and Performance. 18:1992;1121-1138.
21. Ojemann G. A. Cortical organization of language. Journal of Neuroscience. 11:1991;2281-2287.
22. Payne B. R., Lomber S. G., Villa A. E. P., Bullier J. Reversible deactivation of cerebral network components. Trends in Neuroscience. 19:1996;535-542.
23. Perrone, M. (1994). General averaging results for convex optimisation. In Proceedings of the 1993 Connectionist Models Summer School (pp. 364-371). Hillsdale, NJ: Erlbaum.
24. Perrone, M. P., & Cooper, L. N. (1993). When networks disagree: ensemble methods for hybrid neural networks. In R. J. Mammone (Ed.), Neural networks for speech and image processing (pp. 81-99). London: Chapman-Hall.
25. Quinlan, J. R. (1993). C4.5: programs for empirical learning. San Francisco: Morgan Kaufmann.
26. Reed R. Pruning algorithms a survey. IEEE Transactions on Neural Networks. 4:1993;740-747.
27. Requin J., Riehle A., Seal J. Neuronal activity and information processing in motor control: from stages to continuousl flow. Biological Psychology. 26:1988;179-188.
28. Skouras K., Goutis C., Bramson M. J. Estimation in linear models using gradient descent with early stopping. Statistics and Computing. 4:1994;271-278.
29. Steriade, M., Jones, E. G., & Llinas, R. R. (1990). Thalamic oscillations and signalling. New York: Wiley.
30. Steriade M., Llinas R. R. The functional states of the thalamus and the associated neuronal interplay. Physiological Review. 68:1988;649-742.
31. Taylor J. G. Towards a neural network of mind. Neural Network World. 2:1992;797-812.
32. Taylor, J. G., & Alavi, F. (1993). Mathematical analysis of a competitive network for attention. In J. G. Taylor (Ed.), Mathematical approaches to neural networks (pp. 341-382). Amsterdam: Elsevier.
33. Tetko I. V., Livingstone D. J., Luik A. I. Neural network studies. 1: comparison of overfitting and overtraining. Journal of Chemical Information and Computer Sciences. 35:1995;826-833.
34. Tollenaere T. SuperSAB: fast adaptive back propagation with good scaling properties. Neural Networks. 3:1990;561-573.
35. Villa A. E. P. Functional differentiation within the auditory part of the thalamic reticular nucleus of the cat. Brain Research Review. 15:1990;25-40.
36. Villa A. E. P., Bajo V. M., Vantini G. Nerve Growth Factor (NGF) modulates information processing in the auditory thalamus. Brain Research Bulletin. 39:1996;139-147.
37. Villa A. E. P., Rouiller E. M., Simm G. M., Zurita P., de Ribaupierre Y., de Ribaupierre F. Corticofugal modulation of information processing in the auditory thalamus of the cat. Experimental Brain Research. 86:1991;506-517.
38. Villa, A. E. P., & Tetko, I. V. (1995). Spatio-temporal patterns of activity controlled by system parameters in a simulated thalamo-cortical neural network. In H. Hermann (Ed.), Supercomputing in brain research: from tomography to neural networks (pp.379-388). Singapore: World Scientific.
39. Villa, A. E. P., Zurita, P., & Jeandrevin, S. (1989). SIRENE: interactive artificial network modeling in computer assisted neurophysiology. In L. Personnaz & G. Dreyfus (Eds.), Neural networks from models to applications (pp. 627-633). Paris: IDSET.
40. Wahba, G. (1995). Generalization and regularization in nonlinear learning systems. In M. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 426-430). MIT Press.
41. Widrow, B., & Stearns, S. (1985). Adaptive signal processing. Englewood Cliffs, NJ: Prentice Hall.
42. Winer J. A., Larue D. T. Patterns of reciprocity in auditory thalamocortical and corticothalamic connections: study with horseradish peroxidase and autoradiographic methods in the rat medial geniculate body. Journal of Comparative Neurology. 224:1987;344-370.
43. Yarbus, A. L. (1967). Eye movements and vision process. New York: Plenum.