Clustering ensembles of neural network models

Neural Networks

Volumn 16, Issue 2, 2003, Pages 261-269

  Bakker, Bart ^a   Heskes, Tom ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Bias variance analysis; Bootstrapping; Clustering; Deterministic annealing; Expectation maximization algorithm; Multilayered perceptron; Multitask learning; Nonlinear model

Indexed keywords

IMAGE ANALYSIS; PROBABILITY DISTRIBUTIONS; SAMPLING;

BOOTSTRAPPING;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; EXPERIMENTAL MODEL; PREDICTION; PRIORITY JOURNAL; PROBABILITY; TECHNIQUE;

ALGORITHMS; CLUSTER ANALYSIS; LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 0037337904     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(02)00187-9     Document Type: Article

References (23)

1. Bakker B., Heskes T. Model clustering by deterministic annealing. Verleysen M. Proceedings of the European Symposium on Artificial Neural Networks'99. 1999;87-92.
2. Bishop C. Neural networks for pattern recognition. 1995;Clarendon Press, Oxford.
3. Breiman L. Bagging predictors. Machine Learning. 24:1996;123-140.
4. Breiman L. Arcing classiers. The Annals of Statistics. 26:1998.
5. Buhmann J., Kühnel H. Vector quantization with complexity costs. IEEE Transactions on Information Theory. 39:(4):1993;1133-1145.
6. Cadez, I., Gaffney, S., & Smyth, P (2000). A general probabilistic framework for clustering individuals and objects. Proceedings of the ACM SIGKDD Conference (pp. 140-149).
7. Caruana R. Multitask learning. Machine Learning. 28:1997;41-75.
8. Domingos, P (1997). Why does bagging work? A Bayesian account and its implications. Proceedings of the Third International Conference on Knowledge Discovery and Data Mining (pp. 155-158).
9. Efron B., Tibshirani R. An introduction to the bootstrap. 1993;Chapman and Hall, London.
10. Harrison D., Rubinfeld D. Hedonic prices and the demand for clean air. Journal of Environmental Economics and Management. 5:1978;81-102.
11. Hashem S. Optimal linear combinations of neural networks. Neural Networks. 10:(4):1996;599-614.
12. Heskes T. Proceedings of the International Conference on Machine Learning. Proceedings of the International Conference on Machine Learning. 1998;Morgan Kaufmann, San Mateo.
13. Jaynes E. Information theory and statistical mechanics. Physical Review. 106:1957;620-630.
14. Miller D., Rose K. Hierarchical, unsupervised learning with growing via phase transitions. Neural Computation. 8:1996;425-450.
15. Neal R. Bayesian learning for neural networks. 1996;Springer, New York.
16. Partridge D., Yates W. Engineering multiversion neural-net systems. Neural Computation. 8:(4):1996;869-893.
17. Perrone M., Cooper L. When networks disagree: ensemble methods for hybrid neural networks. Mammone R. Neural networks for speech and image processing. 1993;126-142 Chapman and Hall, London. Chapter 10.
18. Roli F., Giacinto G., Vernazza G. Methods for designing multiple classifier systems. Multiple Classifier Systems. 2001;78-87.
19. Rose K., Gurewitz E., Fox G. Statistical mechanics of phase transitions in clustering. Physical Review Letters. 65:1990;945-948.
20. Rubin D.B. EM and beyond. Psychometrika. 56:(2):1991;241-254.
21. Rüger S., Ossen A. Clustering in weight space of feedforward nets. Von der Malsburg C. ICANN'96. 1996;83-88 Springer, Berlin.
22. Sharkey A., Sharkey N., Gerecke U., Chandroth G. The test and select approach to ensemble combination. Multiple Classifier Systems. 2000;30-44.
23. Vlassis N., Likas A. A greedy EM algorithm for Gaussian mixture learning. Neural Processing Letters. 15:2002;. in press.