Agnostic learning with ensembles of classifiers

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 2887-2891

  Wichard, Jörg D ^a,b  

^a LEIBNIZ INSTITUT FÜR MOLEKULARE PHARMAKOLOGIE   (Germany)

^b CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; COMPUTER NETWORKS; LEARNING SYSTEMS; PARAMETER ESTIMATION;

JOINT CONFERENCE; MODEL PARAMETER ESTIMATION;

NEURAL NETWORKS;

EID: 51749118482     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4371418     Document Type: Conference Paper

References (35)

1. L. Hansen, P. Salamon, Neural network ensembles, IEEE Trans. on Pattern Analysis and Machine Intelligence 12 (10) (1990) 993-1001.
2. S. Geman, E. Bienenstock, R. Doursat, Neural networks and the bias/variance dilemma, Neural Computation 4 (1992) 1-58.
3. M. P. Perrone, L. N. Cooper, When Networks Disagree: Ensemble Methods for Hybrid Neural Networks, in: R. J. Mammone (Ed.), Neural Networks for Speech and Image Processing, Chapman-Hall, 1993, pp. 126-142.
4. R. Kohavi, D. Wolpert, Bias plus variance decomposition for zero-one loss functions, in: L. Saitta (Ed.), Proceedings of the Thirteenth International Conference on Machine Learning, Morgan Kaufmann, 1996, pp. 275-283.
5. P. Domingos, A unified bias-variance decomposition for zero-one and squared loss, in: Proc. of the 17 th National Conference on Artifcial Intelligence, 2000, pp. 564-569.
6. A. Krogh, J. Vedelsby, Neural network ensembles, cross validation, and active learning, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems, Vol. 7, The MIT Press, 1995, pp. 231-238.
7. U. Naftaly, N. Intrator, D. Horn, Optimal ensemble averaging of neural networks, Network, Comp. Neural Sys. 8 (1997) 283-296.
8. A. Krogh, P. Sollich, Statistical mechanics of ensemble learning, Physical Review E 55 (1) (1997) 811-825.
9. L. Breiman, Bagging predictors, Machine Learning 24 (2) (1996) 123-140.
10. A. Rothfuss, T. Steger-Hartmann, N. Heinrich, J. Wichard, Computational prediction of the chromosome-damaging potential of chemicals, Chemical Research in Toxicology 19 (10) (2006) 1313-1319.
11. T. Taskaya-Temizel, M. Casey, A comparative study of autoregressive neural network hybrids, Neural Networks 18 (5-6) (2005) 781-789.
12. T. Hashem, B. Schmeiser, Improving model accuracy using optimal linear combinations of trained neural networks, IEEE Trans. Neural Networks 6 (3) (1995) 792-794.
13. E. Kong, T. Dietterich, Error-correcting output coding corrects bias and variance, in: Proc. of the International Conference on Machine Learning, 1995, pp. 313-321.
14. T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, Springer Series in Statistics, Springer-Verlag, 2001.
15. C. Schaffer, Selecting a classification method by mross-validation, in: Fourth Intl. Workshop on Artificial Intelligence & Statistics, 1993, pp. 15-25.
16. J. Quinlan, Comparing connectionist and symbolic learning methods, Vol. I, MIT Press, 1994, pp. 445-456.
17. I. Guyon, A. Elisseeff, An introduction to variable and feature selection, Journal of Machine Learning Research 3 (2003) 1157-1182.
18. D. Wolpert, Stacked generalization, Neural Networks 5 (1992) 241-259.
19. J. Wichard, M. Ogorzałek, C. Merkwirth, Detecting correlation in stock markets, Physica A 344 (2004) 308-311.
20. J. Wichard, M. Ogorzałek, Time series prediction with ensemble models, in: Proc. IJCNN 2004, 2004, pp. 1625-1629.
21. J. Wichard, Model selection in an ensemble framework, in: Proceedings of the IEEE World Congress on Computational Intelligence, Vancouver, Canada, 2006, pp. 4189-4194.
22. C. Merkwirth, M. Ogorzałek, J. Wichard, Stochastic gradient descent training of ensembles of DT-CNN classifiers for digit recognition, in: Proceedings of the ECCTD, Vol. 2, Kraków, Poland, 2003, pp. 337-341.
23. J. Wichard, C. Merkwirth, ENTOOL - A Matlab toolbox for ensemble modeling (2007). URL http://www.j-wichard.de/entool/
24. L. Breiman, J. Friedman, R. Olshen, C. Stone, Classification and Regression Trees, Wadsworth and Brooks, Monterey, CA, 1984, new edition 1993.
25. Y. LeCun, L. Bottou, G. Orr, K. Müller, Efficient BackProp, in: G. Orr, K. Müller (Eds.), Neural Networks: Tricks of the trade, Vol. 1524 of Lecture Notes in Computer Science, Springer Verlag, 1998, pp. 9-50.
26. M. Riedmiller, H. Braun, A direct adaptive method for faster back-propagation learning: The RPROP algorithm, in: Proc. of the IEEE Int. Conf. on Neural Networks, San Francisco, CA, 1993, pp. 586-591.
27. C. Igel, M. Hüsken, Improving the Rprop learning algorithm, in: H. Bothe, R. Rojas (Eds.), Proceedings of the Second International ICSC Symposium on Neural Computation (NC 2000), ICSC Academic Press, 2000, pp. 115-121.
28. N. Cristianini, J. Shawe-Taylor, An introduction to support vector machines and other kernel-based learning methods, Cambridge University Press, 2000.
29. V. Vapnik, A. J. Tscherwonenkis, Theorie der Zeichenerkennung, Akademie Verlag Verlag, Berlin, 1979.
30. V. Vapnik, The Nature of Statistical Learning Theory, Springer Verlag, New York, 1999.
31. B. Boser, I. Guyon, V. Vapnik, A training algorithm for optimal margin classifiers, in: In Proc. of the Fifth Annual Workshop on Computational Learning Theory, 1992, pp. 144-152.
32. C. C. Chang, C. Lin, Libsvm - A library for support vector machines (2001). URL http://www.csie.ntu.edu.tw/~cjlin/libsvm
33. I. Guyon, et al., Agnostic Learning vs. Prior Knowledge Challenge & Data Representation Discovery Workshop, IJCNN 2007, Orlando, Florida.
34. R. Lutz, Logitboost with trees applied to the WCCI 2006 performance prediction challenge datasets, in: Proceedings of the IEEE World Congress on Computational Intelligence, Vancouver, Canada, 2006, pp. 2966-2969.
35. I. Guyon, et al., Performance Prediction Challenge, WCCI 2006, Vancouver, Canada.