A mutual information based ensemble method to estimate Bayes error

Intelligent Engineering Systems Through Artificial Neural Networks

Volumn 1998, Issue , 1998, Pages 17-22

  Tumer, Kagan ^a   Bollacker, Kurt ^b   Ghosh, Joydeep ^b  

^a NASA AMES RESEARCH CENTER   (United States)

^b The University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYES ERROR ESTIMATION; ERROR CORRELATION; UNDERWATER ACOUSTIC DATA;

ERRORS; ESTIMATION; LEARNING ALGORITHMS; PATTERN RECOGNITION; UNDERWATER ACOUSTICS;

NEURAL NETWORKS;

EID: 0032295504     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (16)

1. Battiti, R. (1994). Using mutual information for selecting features in supervised neural net learning. IEEE Transactions an Neural Networks, 5:4:537-550.
2. Bollacker, K. D. and Ghosh, J. (1996). Linear feature extractors based on mutual information. In Proceedings of the 13th International Conference on Pattern Recognition.
3. Buturović, L. J. (1993). Improving k-nearest neighbor density and error estimates. Pattern Recognition, 26(4):611-616.
4. Cover, T. M. and Hart, P. E. (1967). Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13:21-27.
5. Cover, T. M. and Thomas, J. A. (1991). Elements of Information Theory. Wiley.
6. Devijver, P. and Kittler, J. (1982). Pattern Recognition: A Statistical Approach. Prentice-Hall.
7. Djouadi, A., Snorrason, O., and Garber, F. D. (1990). The quality of training-sample estimates of the Battacharyya coefficient. IEEE Trans. on Pat. Ana. and Mac. Intel., 12(1):92-97.
8. Fraser, A. M. and Swinney, H. L. (1986). Independent coordinates for strange attractors from mutual information. Physical Review A, 33:1134-1140.
9. Fukunaga, K. (1985). The estimation of the Bayes error by the k-nearest neighbor approach. In Kanal, L. N. and Rosenfeld, A., editors, Progress in Pattern Recognition 2, pages 169-187. North-Holland, Amsterdam.
10. Fukunaga, K. (1990). Introduction to Statistical Pattern Recognition. Academic Press.
11. Garber, F. and Djouadi, A. (1988). Bounds on the Bayes classification error based on pairwisc risk functions. IEEE Tran. on Pattern Analysis and Machine Intel., 10(3):281-288.
12. Noordewier, M. O., Towell, G. G., and Shavlik, J. W. (1991). Training knowledge-based neural networks to recognize genes in DNA sequences. In Advances in Neural Information Processing Systems-3, pages 530-536. Morgan Kaufmann.
13. Prechelt, L. (1994). PROBEN1 - A set of benchmarks and benchmarking rules for neural network training algorithms. Technical Report 21/94, Fakultät für Informatik, Universität Karlsruhe, D-76128 Karlsruhe, Germany. Anonymous FTP: /pub/papers/techreports/1994/1994-21.ps.Z on ftp.ira.uka.de.
14. Turner, K. and Ghosh, J. (1995). Limits to performance gains in combined neural classifiers. In Proc. of the Artificial Neural Networks in Engineering '95, pages 419-424, St. Louis.
15. Tumer, K. and Ghosh, J. (1996a). Error correlation and error reduction in ensemble classifiers. Connection Science, Special Issue on Combining Artificial Neural Networks: Ensemble Approaches, 8(3 & 4):385-404.
16. Tumer, K. and Ghosh, J. (1996b). Estimating the Bayes error rate through classifier combining. In Proc. of the Int. Conf. on Pattern Recognition, Vienna, Austria, pages IV:695-699.