Why are neural networks sometimes much more accurate than decision trees: An analysis on a bio-informatics problem

Proceedings of the IEEE International Conference on Systems, Man and Cybernetics

Volumn 3, Issue , 2003, Pages 2851-2856

  Hall, Lawrence O ^a   Liu, Xiaomei ^b   Bowyer, Kevin W ^b   Banfield, Robert ^a  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b University of Notre Dame   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMINO ACIDS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATHEMATICAL TRANSFORMATIONS; PROTEINS; STATISTICAL METHODS; TREES (MATHEMATICS);

BIO-INFORMATICS; DECISION TREES;

NEURAL NETWORKS;

EID: 0242552793     PISSN: 08843627     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Martin Anthony and Peter Bartlett. Neural Network Learning: Theoretical Foundations. Cambridge University press, 1999.
2. NCBI BLAST homepage. http://www.ncbi.nlm.nih.gov/BLAST/.
3. D.E. Brown, V. Corruble, and C.L. Pittard. A comparison of decision tree classifiers with backpropagation neural networks for multimodal classification problems. Pattern Recognition, 26(6):953-961, 1993.
4. J. L. Castro, C. J. Mantas, and J. M. Benitez. Neural networks with a continuous squashing function in the output are universal approximators. Neural Networks, 13(6):561-563, 2000.
5. N. Chawla, T.E. Moore, K.W. Bowyer, L.O. Hall, C. Springer, and W.P. Kegelmeyer. Bagging-like effects for decision trees and neural nets in protein secondary structure prediction. In BIOKDD01: Workshop on DataMining in Bioinformatics at KDD01, pages 50-59, 2001.
6. N.V. Chawla, T.E. Moore, L.O. Hall, K.W. Bowyer, W.P. Kegelmeyer, and C. Springer. Distributed learning with bagging-like performance. Pattern Recognition Letters, 24(1-3):455-471, 2003.
7. T. G. Dietterich. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning, 40(2):139-158, 2000.
8. T.G. Dietterich, H. Hild, and G. Bakiri. A comparison of ID3 and backpropagation for english text-to-speech mapping. Machine Learning, 18(1):51-80, 1995.
9. L.O. Hall, K.W. Bowyer, R.E. Banfield, S. Eschrich, and R. Collins. Is error-based pruning redeemable? International Journal on Artificial Intelligence Tools, 12(3), Sept 2003. To Appear. http://www.csee.usf.edu/~hall/ictai02.pdf.
10. K. Hornik, M. Stinchcombe, and H. White. Multilayer feedforward networks are universal approximators. Neural Networks, 2:359-366, 1989.
11. D.T. Jones. Protein secondary structure prediction based on decision-specific scoring matrices. Journal of Molecular Biology, 292:195-202, 1999.
12. Kdd cup 2001. http://www.cs.wisc.edu/~page/kddcup2001/.
13. T-S Lim, W-Y Loh, and Y-S Shih. A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Machine Learning, 40(3):203-228, 2000.
14. R. Mooney, J. Shavlik, G. Towell, and A. Gove. An experimental comparison of symbolic and connectionist learning algorithms. In IJCAI-89 Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, volume 1, pages 775-780, 1989.
15. Petra Perner, Uwe Zscherpel, and Carsten Jacobsen. A comparison between neural networks and decision trees based on data from industrial radiographic testing. Pattern Recognition Letters, 22(1):47-54, 2001.
16. Protein structure prediction center. http://predictioncenter.llnl.gov/.
17. J.R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann, 1992. San Mateo, CA.
18. J.R. Quinlan. Improved use of continuous attributes in C4.5. Journal of Artificial Intelligence Research, 4:77-90, 1996.
19. I.K. Sethi and M. Otten. Comparison between entropy net and decision tree classifiers. In IJCNN International Joint Conference on Neural Networks, volume 3, pages 63-68, 1990.
20. J.W. Shavlik, R.J. Mooney, and G.G. Towell. Symbolic and neural learning algorithms: an experimental comparison, machine learning. Machine Learning, 6(2):111-143, 1991.