Statlog: Comparison of classification algorithms on large real-world problems

Applied Artificial Intelligence

Volumn 9, Issue 3, 1995, Pages 289-333

  King, R D ^a   Feng, C ^b   Sutherland, A ^a  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^b ALAN TURING INSTITUTE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL METHODS; DATA PROCESSING; DATA STRUCTURES; IMAGE ANALYSIS; LARGE SCALE SYSTEMS; LEARNING ALGORITHMS; NEURAL NETWORKS; PROBLEM SOLVING; STATISTICS;

CLASSIFICATION ALGORITHMS; LARGE REAL WORLD PROBLEMS; STATLOG PROJECT; SYMBOLIC LEARNING;

ALGORITHMS;

EID: 0029306995     PISSN: 08839514     EISSN: 10876545     Source Type: Journal    
DOI: 10.1080/08839519508945477     Document Type: Article

References (68)

1. Acid, S„ S L. de Campos, A Gonzslez, R. Molina, and P de la Blanca. 1991. CASTLE: A tool for Bayesian learning. Paper presented at Esprit Conference 1991.
2. Aha, D. 1992. Generalising case studies: A case study. In 9th international conference on Machine learning, pp. 1-10. San Mateo, Calif.: Morgan Kaufmann.
3. Aha, D. W„ D. Kibler, and M. K. Albert. 1991. Instance-based learning algorithms. Machine Learning 6: pp. 37-66.
4. Atlas, L., J. Connor, D. Park, M. El-Sharkawi, R. Marks, A. Lippman, R. Cole, and Y. Muthasamy. 1991. A performance comparison of trained multi-layer perceptions and trained classification trees. Systems, man, and cybernetics: Proceedings of the 1989 IEEE international conference, Cambridge. Mass., pp. 915-20.
5. Bonelli, P. and A. Parodi. 1991. An efficient classifier system and its experimental comparisons with two representative learning methods on three medical domains. In ICGA-91: Genetic algorithms. Proceedings of the fourth international conference, pp. 288-95. San Mateo, Calif.: Morgan Kaufmann.
6. Breiman, L., I. H. Friedman, R. A. Olshen, and C. J. Stone. 1984. Classification and regression trees. Belmont, Calif.: Wadsworth.
7. Buntine, W. 1989. Learning classification rules using Bayes. In Proceedings of the sixth international machine learning workshop, Cornell, New York, pp. 94—98. San Mateo, Calif.: Morgan Kaufmann.
8. Cherkaoui, O., and R. Cleroux, 1991. Comparative study of six discriminant analysis procedures for mixtures of variables. In Proceedings of interface conference 1991. San Mateo, Calif.: Morgan Kaufmann.
9. Clark, P., and R. Boswell. 1991. Rule induction with CN2: Some recent improvements. In EWSL 91, Porto, Portugal, pp. 151-63. Berlin: Springer-Verlag.
10. Clark, P„ and T. Niblett. 1988. The CN2 induction algorithm. Machine Learning 3(4):261-83.
11. Cox, D. R. 1966. Some procedures associated with the logistic qualitative response curve. In Research papers in statistics: Frestschrififorj. Neyman, vol. 45. Edited by F. N. David. New York: Wiley.
12. Day, N., and D. Kerridge. 1967. A general maximum likelihood discriminant. Biometrics 23:313-23.
13. Ersoy, O. K., and D. Hong. 1991. Parallel, self-organizing, hierarchical neural networks for vision and systems control. In Intelligent motion control.Proceedings of the IEEE international workshop. Edited by O. Kaynak. New York: IEEE.
14. Fahlman, S. 1989. Distributed connectionist systems for At: Prospects and problems. In Concepts and characteristics of knowledge-based systems: Selected and reviewed papers from the IFIP TC 10IWG 10.1 workshop. Mount Fuji, Japan, 9-12 November 1987, pp. 23-35. Amsterdam: North-Holland.
15. Fahlman, S. 1991. The cascade-correlation learning algorithm on the MONK’S problems. In The MONK’s problems—A performance comparison of different learning algorithms, pp, 107-12. Edited by S. Thrun, J. Bala, E. Bloedom. and I. Bratko. Pittsburgh, Pa.: Computer Science Department, Carnegie Mellon University.
16. Feng, C., A. Sutherland, R. King, and R. Henery. 1993. Comparing machine learning classifiers to statistics and neural networks. In Proceedings of international conference on artificial intelligence and statistics. Florida: Society of AI and Statistics and IASC.
17. Fisher, D. H., and K. B. McKusick. 1989. An empirical comparison of ID3 and backpropagation, In IJCAI89, vol. 1, pp. 788-93. San Mateo, Calif.: Morgan Kaufmann.
18. Fisher D. K. McKusick, R. Mooney, J. W. Shavlik, and G. Towell. 1989. Processing issues in comparisons of symbolic and connectionist learning systems. In Proceedings of the sixth international workshop on machine learning. Cornel University, Ithaca, New York, June 26-27,1989, pp. 169-73. San Mateo, Calif.: Morgan Kaufmann.
19. Friedman, J. H., and W. Stuetzle. 1981. Projection pursuit regression. Journal of American Statistical Association 76:817-23.
20. Goodman, R. M., and P. Smyth. 1989. The induction of probabilistic rule sets—The ITnile algorithm. In Proceedings of the sixth international workshop on machine learning, Cornell University, Ithaca, New York, pp. 129-32. San Mateo, Calif.: Morgan Kaufmann.
21. Gordon, L, and R. A. Olshen. 1978. Asymptotically efficient solutions to the classification problem. Annals of Statistics 6:515-33.
22. Gorman, R. P„ and T. J. Sejnowski. 1988. Analysis of hidden units in a layered network trained to classify sonar targets. Neural Networks 1(Part 1):75—89.
23. Hand, D. J. 1981. Discrimination and classification. Chichester, England: Wiley.
24. Hermans, J., J. D. F. Habbema, and A. T Van der Burght. 1974. Cases of doubt in allocation problems: & populations. Bulletin of International Statistics Institute 45:523-29.
25. Huang, H. H., C. Zhang, S. Lee, and H. P. Wang. 1991. Implementation and comparison of neural network learning paradigms: Backpropagation, simulated annealing and tabu search. In Intelligent engineering systems through artificial neural networks: Proceedings of the artificial neural networks in engineering conference. New York: American Society of Mechanical Engineers.
26. Huang, W Y., and R. P Lippmann. 1987. Comparisons between neural net and conventional classifiers. In Proceedings of the IEEE first international conference on neural networks, pp. 485-94. New York: IEEE.
27. Kendall, M. G., A. Stuart, and J. K. Ord. 1983. The advanced theory of statistics, vol. 3.Design, analysis and time series. London, UK: Griffin.
28. King, R., R Henery, C. Feng, and A. Sutherland. 1994. A comparative study of classification algorithms: Statistical, machine learning, and neural network. In Machine intelligence 13. Edited by D. Michie, S. Muggleton, and K. Furakawa. New York: Oxford University Press.
29. Kirkwood, C. B. Andrews, and P. Mowforth. 1989. Automatic detection of gait events: A case study using inductive learning techniques. Journal of Biomedical Engineering 11 (23):511-16.
30. Kressel, U. 1991. The impact of the learning set size in handwritten digit recognition. In Proceedings of the International Conference on Artificial Neural Networks.
31. Lauritzen, S. L., and D. J. Spiegelhalter. 1988. Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society, Series B 50:157-224.
32. McClelland, J. L., D. E. Rumelhart, and G. E. Hinton. 1986. Parallel distributed processing: Explorations in the microstructure of cognition, vols. I, II, and III. Cambridge, Mass.: MIT Press.
33. Meyer-Broetz, G., and J. Schuermann. 1970. Methoden der automatischen Zeichenerkennung. Berlin: Akademie Verlag.
34. Michalski, R. S. 1983. A theory and methodology of inductive learning. Artificial Intelligence 20(2): 111-61.
35. Michie, D., D. J. Spiegelhalter, and C. G. Taylor. 1994. Machine learning, neural and statistical classification. Hemel Hempstead, UK: Ellis Horwood.
36. Mooney, R., J. Shavlik, G. Towell, and A. Gove. 1989. An experimental comparison of symbolic and connectionist learning algorithms, vol. 1. In 1JCAI 89: Proceedings of the eleventh international joint conference on artificial intelligence, 20-25 August 1989, Detroit, Ml, pp. 775—80. San Mateo, Calif.: Morgan Kaufmann.
37. Pearl, J. 1988. Probabilistic reasoning in intelligent systems. San Mateo, Calif,: Morgan Kaufmann.
38. Poggio, T., and F. Girosi. 1991. Networks for approximation and learning. In Proceedings of the IEEE 78(9): 1481-97.
39. Preparata, F. P., and M. I. Shamos. 1985. Computational geometry: An introduction. New York: Springer-Verlag.
40. Quinlan J. 1986. Induction of decision trees. Machine Learning 1(1):81—106.
41. Quinlan, J. R. 1987a. Simplifying decision trees. International Journal of Man-Machine Studies 27(3):221-34.
42. Quinlan, J. R. 1987b. Generating production rules from decision trees. In International joint conference on artificial intelligence, Milan, pp. 304-307. San Mateo, Calif.: Morgan Kaufmann.
43. Quinlan, J. R„ P. J. Compton, K. A. Horn, and L. Lazarus. 1986. Inductive knowledge acquisition: A case study. In Proceedings of the second Australian conference on applications of expert systems, Sydney, 14-16 May 1986, pp. 183-204. Sydney, New South Wales: Institute of Technology.
44. Read, T. R. C., and N. Cressie. 1988. Goodness of fit statistics for discrete multivariate data. New York: Springer Verlag.
45. Remme, J., J. D. F. Habbema, and J. Hermans. 1980. A simulative comparison of linear, quadratic and kernel discrimination. Journal of Statistics and Computer Simulation 11:87-106.
46. Renats, S., and R. Rohwer. 1989. Phoneme classification experiments using radial basis functions. In IJCNN-89: Proceedings of the international joint conference on neural networks, Washington, D.C., USA, 1989, vol. 1, pp. 461-67. New York: IEEE.
47. Ripley, B. D. 1992. Statistical aspects of neural networks. In SemSat, Sandbjerg, Denmark, April. London, UK: Chapman and Hall.
48. Rivest, R. L. 1987. Learning decision lists. Machine Learning 2(3):229-46.
49. Rumelhart, D. E., G. E. Hinton, and R. J. Williams. 1986. Learning representations by back-propagating errors. In Neurocomputing: Foundations of research, pp. 696-99. Cambridge, Mass.: MIT Press.
50. Samrnut, C. 1988. Experimental results from an evaluation of algorithms that learn to control dynamic systems. In Proceedings of the fifth international conference on machine learning, Ann Arbor, Michigan, June 12-14, 1988, pp. 437-43. San Mateo, Calif.: Morgan Kaufmann.
51. Segre, A. M., ed. 1989. Proceedings of the sixth international machine learning workshop, Cornell, New York. San Mateo, Calif.: Morgan Kaufmann.
52. Sethi, I. K., and M. Otten. 1990. Comparison between entropy net and decision tree classifiers. In UCNN-90: Proceedings of the international joint conference on neural networks, pp. 63-68. Ann Arbor, Mich.: IEEE Neural Networks Council.
53. Shavlik, J. W., R. J. Mooney, and G. G. Towell. 1991. Symbolic and neural learning algorithms: An experimental comparison. Journal of Machine Learning 6:111-43.
54. Siebert, J. P. 1987. Vehicle recognition using rule-based methods. Report Tirm-87-018, The Turing Institute, Glasgow, UK.
55. Smith, J. W., J. E. Everhart, W. C. Dickson, W. C. Knowler, and R. S. Johannes. 1991. Using the ADAP learning algorithm to forecast the onset of diabetes mel li tus. In Proceedings of the symposium on computer applications and medical care, pp. 261-65. New York: IEEE Computer Society Press.
56. Spiegelhalter, D. J. 1990. Probabilistic methods and the interface with statistics. In Colloquium on reasoning and uncertainty organised by professional group C4 (artificial intelligence). New York: IEEE Computing and Control Division.
57. Spikovska, L., and M. B. Reid. 1990. An empirical comparison of ID3 and HONNS for distortion invariant object recognition. In TAI-90: Tools for artificial intelligence: Proceedings of the 2nd international IEEE conference, Los Alamitos, CA. New York: IEEE Computer Society Press.
58. Stone, M. 1974. Cross-validatory choice and assessment of statistical predictions. Journal of Royal Statistics Society B 36:111-33.
59. Sutherland, A., R. Henery, and C. Feng. 1992, Statlog—An ESPRIT project for the comparison of statistical and logical learning algorithms. Paper presented at the Conference on New Techniques and Technology in Statistics, Bonn, Germany.
60. Thrun, S. B.T. Mitchell, and J. Cheng. 1991. The MONK’s comparison of learning algorithms—introduction and survey. In The MONK’S problems—A performance comparison of different learning algorithms, pp. 1-6. Edited by S. Thrun, J. Bala, E. Bloedom, and I. Bratko. Pittsburgh, Pa.: Computer Science Department, Carnegie Mellon University.
61. Titterington, D. M., G. D. Murray, L. S. Murray, D. J. Spiegelhalter, A. M. Skene, J. D. F. Habbema, and G. J. Gelpke. 1981. Comparison of discrimination techniques applied to a complex data set of head injured patients. Journal of the Royal Statistical Society 144:145-75.
62. Tsaptsinos, D„ A. Mirzai, and B. Jervis. 1990. Comparison of machine learning paradigms in a classification task. In Applications of artificial intelligence in engineering V: Proceedings of the fifth international conference. Berlin: Springer-Verlag.
63. Unger, S., and F. Wysotzki. 1981. Methoden der automatischen Zeichenerkennung. Berlin: Akademie Verlag.
64. van Cutsem, T., L. Wehenkel, M. Pavella, B. Heilbronn, and M. Goubin. 1991. Decision trees for detecting emergency voltage conditions. In 2nd International workshop on bulk power system voltage phenomena— Voltage stability and security. U.S.A. McHenry.
65. Weiss, S. M., and I. Kapouleas. 1989. An empirical comparison of pattern recognition, neural nets and machine learning classification methods, vol. 1. In IJCAJ89,20-25 August 1989, Detroit, Ml, pp. 781-87. San Mateo, Calif,: Morgan Kaufmann.
66. Weiss, S. M., and C. A. Kulikowski. 1991. Computer systems that learn: Classification and prediction methods from statistics, neural networks, machine learning, and expert systems. San Mateo, Calif.: Morgan Kaufmann.
67. Weiss, S. M., R. S. Galen, and P. V. Tadepalli. 1990. Maximizing the predictive value of production rules. Artificial Intelligence 45:47-71.
68. Xu, L., A. Krzyzak, and E. Oja. 1991. Neural nets for dual subspace pattern recognition method. International Journal of Neural Systems 2:169-84.