Neural networks for classification: A survey

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 30, Issue 4, 2000, Pages 451-462

  Zhang, Guoqiang Peter ^a  

^a GEORGIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS; PROBABILITY;

BAYESIAN CLASSIFIER; FEATURE VARIABLE SELECTION; NEURAL NETWORK CLASSIFICATION;

NEURAL NETWORKS;

EID: 0034313673     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/5326.897072     Document Type: Article

References (196)

1. K. Al-Ghoneim and B. V. K. V. Kumar, "Learning ranks with neural networks,"in Proc. SPIE Applications Science Artificial Neural Networks, vol. 2492, 1995, pp. 446-464.
2. E. I. Altman, G. Marco, and F. Varetto, "Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience)," J. Bank. Finance, vol. 18, pp. 505-529, 1994.
3. B. Amirikian and H. Nishimura, "What size network is good for generalization of a specific task of interest?," Neural Networks, vol. 7, no. 2, pp. 321-329, 1994.
4. U. Anders and O. Korn, "Model selection in neural networks," Neural Networks, vol. 12, pp. 309-323, 1999.
5. N. P. Archer and S. Wang, "Fuzzy set representation of neural network classification boundaries," IEEE Trans. Syst., Man, Cybern., vol. 21, pp. 735-742, 1991.
6. H. Asoh and N. Otsu, "An approximation of nonlinear discriminant analysis by multilayer neural networks," in Proc. Int. Joint Conf. Neural Networks, San Diego, CA, 1990, pp. III-211-III-216.
7. L. Atlas, R. Cole, J. Connor, M. El-Sharkawi, R. J. Marks II, Y. Muthusamy, and E. Barnard, "Performance comparisons between backpropagation networks and classification trees on three real-world applications," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1990, vol. 2, pp. 622-629.
8. R. Avnimelech and N. Intrator, "Boosted mixture of experts: An ensemble learning scheme," Neural Comput., vol. 11, pp. 483-497, 1999.
9. A. Babloyantz and V. V. Ivanov, "Neural networks in cardiac arrhythmias," in Industrial Applications of Neural Networks, F. F. Soulie and P. Gallinari, Eds, Singapore: World Scientific, 1998, pp. 403-417.
10. P. F. Baldi and K. Hornik, "Learning in linear neural networks: A survey," IEEE Trans. Neural Networks, vol. 6, pp. 837-858, 1995.
11. E. B. Barlett and R. E. Uhrig, "Nuclear power plant status diagnostics using artificial neural networks," Nucl. Technol., vol. 97, pp. 272-281, 1992.
12. E. Barnard, "Optimization for training neural nets," IEEE Trans. Neural Networks, vol. 3, pp. 232-240, 1992.
13. E. Barnard and E. C. Botha, "Back-propagation uses prior information efficiently," IEEE Trans. Neural Networks, vol. 4, pp. 794-802, 1993.
14. R. Barron, "Statistical properties of artificial neural networks," in Proc. 28th IEEE Conf. Decision Control, vol. 280-285, 1989.
15. R. Battiti, "First- and second-order methods for learning; between steepest descent and Newton's method," Neural Comput., vol. 4, pp. 141-166, 1992.
16. _, "Using mutual information for selecting features in supervised neural net learning," IEEE Trans. Neural Networks, vol. 5, no. 4, pp. 537-550, 1994.
17. R. Battiti and A. M. Colla, "Democracy in neural nets: Voting schemes for classification," Neural Networks, vol. 7, no. 4, pp. 691-709, 1994.
18. E. B. Baum, "What size net gives valid generalization?," Neural Comput., vol. 1, pp. 151-160, 1989.
19. W. G. Baxt, "Use of an artificial neural network for data analysis in clinical decision-making: The diagnosis of acute coronary occlusion," Neural Comput., vol. 2, pp. 480-489, 1990.
20. _, "Use of an artificial neural network for the diagnosis of myocardial infarction," Ann. Internal Med., vol. 115, pp. 843-848, 1991.
21. _, "Improving the accuracy of an artificial neural network using multiple differently trained networks," Neural Comput., vol. 4, pp. 772-780, 1992.
22. L. M. Belue and K. W. Bauer, "Determining input features for multilayer perceptrons," Neurocomputing, vol. 7, pp. 111-121, 1995.
23. J. M. Benitez, J. L. Castro, and I. Requena, "Are artificial neural networks black boxes?," IEEE Trans. Neural Networks, vol. 8, pp. 1156-1164, 1997.
24. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
25. H. Bourlard and N. Morgan, "Continuous speech recognition by connectionist statistical methods," IEEE Trans. Neural Networks, vol. 4, pp. 893-909, 1993.
26. L. Breiman, "Bagging predictors," Mach. Learn., vol. 26, no. 2, pp. 123-140, 1996.
27. _, "Arcing classifiers," Ann. Statist., vol. 26, no. 3, pp. 801-823, 1998.
28. D. E. Brown, V. Corruble, and C. L. Pittard, "A comparison of decision tree classifiers with backpropagation neural networks for multimodal classification problems," Pattern Recognit., vol. 26, pp. 953-961, 1993.
29. W. L. Buntine and A. S. Weigend, "Computing second derivatives in feed-forward networks: A review," IEEE Trans. Neural Networks, vol. 5, pp. 480-488, 1993.
30. H. B. Burke, "Artificial neural networks for cancer research: Outcome prediction," Sem. Surg. Oncol., vol. 10, pp. 73-79, 1994.
31. H. B. Burke, P. H. Goodman, D. B. Rosen, D. E. Henson, J. N. Weinstein, F. E. Harrell, J. R. Marks, D. P. Winchester, and D. G. Bostwick, "Artificial neural networks improve the accuracy of cancer survival prediction," Cancer, vol. 79, pp. 857-862, 1997.
32. B. Cheng and D. Titterington, "Neural networks: A review from a statistical perspective," Statist. Sci., vol. 9, no. 1, pp. 2-54, 1994.
33. A. Ciampi and Y. Lechevallier, "Statistical models as building blocks of neural networks," Commun. Statist., vol. 26, no. 4, pp. 991-1009, 1997.
34. T. Cibas, F. F. Soulie, P. Gallinari, and S. Raudys, "Variable selection with neural networks," Neurocomput., vol. 12, pp. 223-248, 1996.
35. C. S. Cruz and J. R. Dorronsoro, "A nonlinear discriminant algorithm for feature extraction and data classification," IEEE Trans. Neural Networks, vol. 9, pp. 1370-1376, 1998.
36. S. P. Curram and J. Mingers, "Neural networks, decision tree induction and discriminant analysis: An empirical comparison," J. Oper. Res. Soc., vol. 45, no. 4, pp. 440-450, 1994.
37. G. Cybenko, "Approximation by superpositions of a sigmoidal function," Math. Contr. Signals Syst., vol. 2, pp. 303-314, 1989.
38. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. Englewood Cliffs, NJ: Prentice-Hall, 1982.
39. T. G. Dietterich, "Overfilling and undercompuling in machine learning," Comput. Surv., vol. 27, no. 3, pp. 326-327, 1995.
40. T. G. Dietterich and G. Bakiri, "Solving multiclass learning problems via error-correcling output codes," J. Artif. Intell. Res., vol. 2, pp. 263-286, 1995.
41. T. G. Dietterich and E. B. Kong, "Machine learning bias, statistical bias, and statistical variance of decision tree algorithms," Dept. Comput. Sci., Oregon State Univ., Corvallis, Tech. Rep., 1995.
42. P. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
43. R. P. W. Duin, "A nole on comparing classifiers," Pattern Recognit. Lett., vol. 17, pp. 529-536, 1996.
44. S. Dutta and S. Shekhar, "Bond raling: A nonconservative application of neural networks," in Proc. IEEE Int. Conf. Neural Networks, vol. 2, San Diego, CA, 1988, pp. 443-450.
45. B. Efron and R. Tibshirani, An Introduction to the Bootstrap. London, U.K.: Chapman & Hall, 1993.
46. M. Egmont-Petersen, J. L. Talmon, A. Hasman, and A. W. Ambergen, "Assessing the importance of features for multi-layer perceptrons," Neural Networks, vol. 11, pp. 623-635, 1998.
47. A. Flexer, "Statistical evaluation of neural network experiments: Minimum requirements and current practice," in Proc. 13th Eur. Meeting Cybernetics Systems Research, R. Trappl, Ed., 1996, pp. 1005-1008.
48. J. H. Friedman, "On bias, variance, 0/1-loss, and the curse of the dimensionality," Data Mining Knowl. Disc., vol. 1, pp. 55-77, 1997.
49. L.-M. Fu, "Analysis of the dimensionality of neural networks for pattern recognition," Pattern Recognit., vol. 23, pp. 1131-1140, 1990.
50. O. Fujita, "Statistical estimation of the number of hidden units for feedforward neural networks," Neural Networks, vol. 11, pp. 851-859, 1998.
51. K. Fukunaga and R. R. Hayes, "Effects of sample size in classifier design," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 873-885, 1989.
52. K. Funahashi, Introduction to Statistical Pattern Recognition. New York: Academic, 1990.
53. _, "Multilayer neural networks and Bayes decision theory," Neural Networks, vol. 11, pp. 209-213, 1998.
54. P. Gallinari, S. Thiria, R. Badran, and F. Fogelman-Soulie, "On the relationships between discriminant analysis and multilayer perceptrons," Neural Networks, vol. 4, pp. 349-360, 1991.
55. G. D. Garson, "Interpreting neural network connection weights," AI Expert, pp. 47-51, 1991.
56. T. D. Gedeon, "Data mining of inputs: Analysis magnitude and functional measures," Int. J. Neural Syst., vol. 8, no. 1, pp. 209-218, 1997.
57. S. Geman, E. Bienenstock, and T. Doursat, "Neural networks and the bias/variance dilemma," Neural Comput., vol. 5, pp. 1-58, 1992.
58. H. Gish, "A probabilistic approach to the understanding and training of neural network classifiers," in Proc. IEEE Int. Conf. Acoustic, Speech, Signal Processing, 1990, pp. 1361-1364.
59. N. Glick, "Additive estimators for probabilities of correct classification," Pattern Recognit., vol. 10, pp. 211-222, 1978.
60. L. W. Glorfeld, "A methodology for simplification and interpretation of backpropagation-based neural networks models," Expert Syst. Applicat., vol. 10, pp. 37-54, 1996.
61. I. Guyon, "Applications of neural networks to character recognition," Int. J. Pattern Recognit. Artif. Intell., vol. 5, pp. 353-382, 1991.
62. M. T. Hagan and M. Henhaj, "Training feedforward networks with the Marquardt algorithm," IEEE Trans. Neural Networks, vol. 5, pp. 989-993, 1994.
63. J. B. Hampshire and B. A. Perlmutter, "Equivalence proofs for multilayer perceptron classifiers and the Bayesian discriminant function," in Proc. 1990 Connectionist Models Summer School, D. Touretzky, J. Elman, T. Sejnowski, and G. Hinton, Eds. San Mateo, CA, 1990.
64. L. K. Hansen and P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, no. 10, pp. 993-1001, 1990.
65. F. E. Harreli and K. L. Lee, "A comparison of the discriminant analysis and logistic regression under multivariate normality," in Biostatistics: Statistics in Biomedical, Public Health, and Environmental Sciences, P. K. Sen, Ed, Amsterdam, The Netherlands: North Holland, 1985.
66. A. Hart, "Using neural networks for classification tasks - Some experiments on datasets and practical advice," J. Oper. Res. Soc., vol. 43, pp. 215-226, 1992.
67. S. Hashem and B. Schmeiser, "Improving model accuracy using optimal linear combinations of trained neural networks," IEEE Trans. Neural Networks, vol. 6, no. 3, pp. 792-794, 1995.
68. S. Hashem, "Optimal linear combination of neural networks," Neural Networks, vol. 10, no. 4, pp. 599-614, 1997.
69. _, "Treating harmful collinearity in neural network ensembles," in Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems, A. J. C. Sharkey, Ed. Berlin, Germany: Springer-Verlag, 1999, pp. 101-125.
70. J. Hertz, A. Grogh, and R. Palmer, Introduction to the Theory of Neural Computation. Reading, MA: Addison-Wesley, 1991.
71. T. Heskes, "Bias/variance decompositions for likelihood-based estimators," Neural Comput., vol. 10, no. 6, pp. 1425-1434, 1998.
72. M. Hintz-Madsen, L. K. Hansen, J. Larsen, M. W. Pedersen, and M. Larsen, "Neural classifier construction using regularization, pruning and test error estimation," Neural Networks, vol. 11, pp. 1659-1670, 1998.
73. T. K. Ho, J. J. Hull, and S. N. Srihari, "Decision combination in multiple classifier systems," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 66-75, Jan. 1994.
74. L. Holmstrom, P. Koistinen, J. Laaksonen, and E. Oja, "Neural and statistical classifiers-taxonomy and two case studies," IEEE Trans. Neural Networks, vol. 8, pp. 5-17, 1997.
75. M. J. Holt and S. Semnani, "Convergence of back propagation in neural networks using a log-likelihood cost function," Electron. Lett., vol. 26, no. 23, pp. 1964-1965, 1990.
76. R. C. Holte, "Very simple classification rules perform well on most commonly used data sets," Mach. Learn., vol. 11, pp. 63-90, 1993.
77. J. J. Hopfield, "Learning algorithms and probability distributions in feedforward and feedback networks," Proc. Nat. Acad. Sci., vol. 84, pp. 8429-8433, 1987.
78. K. Hornik, "Approximation capabilities of multilayer feedforward networks," Neural Networks, vol. 4, pp. 251-257, 1991.
79. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, pp. 359-366, 1989.
80. J. C. Hoskins, K. M. Kaliyur, and D. M. Himmelblau, "Incipient fault detection and diagnosis using artificial neural networks," in Proc. Int. Joint Conf. Neural Networks, 1990, pp. 81-86.
81. M. Y. Hu, M. S. Hung, M. S. Shanker, and H. Chen, "Using neural networks to predict performance of sino-foreign joint ventures," Int. J. Comput. Intell. Organ., vol. 1, no. 3, pp. 134-143, 1996.
82. W. Y. Huang and R. P. Lippmann, "Comparisons between neural net and conventional classifiers," in IEEE 1st Int. Conf. Neural Networks, San Diego, CA, 1987, pp. 485-493.
83. M. S. Hung, M. Y. Hu, M. S. Shanker, and B. E. Patuwo, "Estimating posterior probabilities in classification problems with neural networks," Int. J. Comput. Intell. Organ., vol. 1, no. 1, pp. 49-60, 1996.
84. R. A. Jacobs, "Methods for combining experts' probability assessments," Neural Comput., vol. 7, pp. 867-888, 1995.
85. _, "Bias/variance analyzes of mixtures-of-experts architectures," Neural Comput., vol. 9, pp. 369-383, 1997.
86. G. James and T. Hastie, "Generalizations of the bias/variance decomposition for prediction error," Dept. Statistics, Stanford Univ., Stanford, CA, Tech. Rep., 1997.
87. C. Ji and S. Ma, "Combinations of weak classifiers," IEEE Trans. Neural Networks, vol. 8, pp. 32-42, Jan. 1997.
88. F. Kanaya and S. Miyake, "Bayes statistical behavior and valid generalization of pattern classifying neural networks," IEEE Trans. Neural Networks, vol. 2, no. 4, pp. 471-475, 1991.
89. J. Karhunen and J. Joutsensalo, "Generalizations of principal component analysis, optimization problems and neural networks," Neural Networks, vol. 8, pp. 549-562, 1995.
90. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 226-239, 1998.
91. D. G. Kleinbaum, L. L. Kupper, and L. E. Chambless, "Logistic regression analysis of epidemiologic data," Theory Practice, Commun. Statist. A, vol. 11, pp. 485-547, 1982.
92. S. Knerr, L. Personnaz, and G. Dreyfus, "Handwritten digit recognition by neural networks with single-layer training," IEEE Trans. Neural Networks, vol. 3, pp. 962-968, 1992.
93. R. Kohavi and D. H. Wolpert, "Bias plus variance decomposition for zero-one loss functions," in Proc. 13th Int. Conf. Machine Learning, 1996, pp. 275-283.
94. E. B. Kong and T. G. Dietterich, "Error-correcting output coding corrects bias and variance," in Proc. 12th Int. Conf. Machine Learning, 1995, pp. 313-321.
95. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," Adv. Neural Inform. Process., vol. 7, pp. 231-238, 1995.
96. R. C. Lacher, P. K. Coats, S. C. Sharma, and L. F. Fant, "A neural network for classifying the financial health of a firm," Eur. J. Oper. Res., vol. 85, pp. 53-65, 1995.
97. J. Lampinen, S. Smolander, and M. Korhonen, "Wood surface inspection system based on generic visual features," in Industrial Applications of Neural Networks, F. F. Soulie and P. Gallinari, Eds, Singapore: World Scientific, 1998, pp. 35-42.
98. Y. Le Cun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubberd, and L. D. Jackel, "Handwritten digit recognition with a back-propagation network," Adv. Neural Inform. Process Syst., vol. 2, pp. 396-404, 1990.
99. Y. Le Cun, J. S. Denker, and S. A. Solla, "Optimal brain damage," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1990, vol. 2, pp. 598-605.
100. D. S. Lee, S. N. Sriharia, and R. Gaborski, "Bayesian and neural-network pattern recognition: A theoretical connection and empirical results with handwritten characters," in Artificial Neural Networks and Statistical Pattern Recognition, I. K. Sethi and A. K. Jain, Eds. New York: Elsevier, 1991, pp. 89-108.
101. M. Leshno and Y. Spector, "Neural network prediction analysis: The bankruptcy case," Neurocomput., vol. 10, pp. 125-147, 1996.
102. M. S. Lewicki, "Bayesian modeling and classification of neural signals," Neural Comput., vol. 6, pp. 1005-1030, 1994.
103. G. S. Lim, M. Alder, and P. Hadingham, "Adaptive quadratic neural nets," Pattern Recognit. Lett., vol. 13, pp. 325-329, 1992.
104. T. S. Lim, W. Y. Loh, and Y. S. Shih, "An empirical comparison of decision trees and other classification methods," Dept. Statistics, Univ. Wisconsin, Madison, Tech. Rep. 979, 1998.
105. R. P. Lippmann, "Pattern classification using neural networks," IEEE Commun. Mag., pp. 47-64, Nov. 1989.
106. _, "Review of neural networks for speech recognition," Neural Comput., vol. 1, pp. 1-38, 1989.
107. D. Lowe and A. R. Webb, "Exploiting prior knowledge in network optimization: An illustration form medical prognosis," Network Comput. Neural Syst., vol. 1, pp. 299-323, 1990.
108. _, "Optimized feature extraction and the Bayes decision in feed-forward classifier networks," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 355-364, 1991.
109. D. C. MacKay, "Bayesian interpolation," Neural Comput., vol. 4, pp. 415-447, 1992.
110. _, "A practical Bayesian framework for backpropagation networks," Neural Comput., vol. 4, pp. 448-472, 1992.
111. G. Mani, "Lowering variance of decisions by using artificial neural network portfolios," Neural Comput., vol. 3, pp. 484-486, 1991.
112. I. S. Markham and C. T. Ragsdale, "Combining neural networks and statistical predictions to solve the classification problem in discriminant analysis," Decis. Sci., vol. 26, pp. 229-241, 1995.
113. G. L. Martin and G. L. Pitman, "Recognizing hand-printed letter and digits using backpropagation learning," Neural Comput., vol. 3, pp. 258-267, 1991.
114. B. Mak and R. W. Blanning, "An empirical measure of element contribution in neural networks," IEEE Trans. Syst., Man, Cybern. C, vol. 28, pp. 561-564, Nov. 1998.
115. D. Michie, D. J. Spiegelhalter, and C. C. Taylor, Eds., Machine Learning, Neural, and Statistical Classification, London, U.K.: Ellis Horwood, 1994.
116. S. Miyake and F. Kanaya, "A neural network approach to a Bayesian statistical decision problem," IEEE Trans. Neural Networks, vol. 2, pp. 538-540, 1991.
117. J. Moody and J. Utans, "Architecture selection strategies for neural networks: Application to corporate bond rating prediction," in Neural Networks in the Capital Markets, A.-P. Refenes, Ed. New York: Wiley, 1995, pp. 277-300.
118. N. Morgan and H. Bourlard, "Generalization and parameter estimation in feedforward nets: Some experiments," Adv. Neural Inform. Process. Syst., vol. 2, pp. 630-637, 1990.
119. M. C. Mozer and P. Smolensky, "Skeletonization: A technique for trimming the fat from a network via relevance assessment," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1989, vol. 1, pp. 107-115.
120. P. Muller and D. R. Insua, "Issues in Bayesian analysis of neural network models," Neural Comput., vol. 10, pp. 749-770, 1998.
121. N. Murata, S. Yoshizawa, and S. Amari, "Learning curves, model selection and complexity of neural networks," in Advances in Neural Information Processing Systems, 5, S. J. Hanson, J. D. Cowan, and C. L. Giles, Eds. San Mateo, CA: Morgan Kaufmann, 1993, pp. 607-614.
122. _, "Network information criterion determining the number of hidden units for artificial neural network models," IEEE Trans. Neural Networks, vol. 5, pp. 865-872, 1994.
123. R. Nath, B. Rajagopalan, and R. Ryker, "Determining the saliency of input variables in neural network classifiers," Comput. Oper. Res., vol. 24, pp. 767-773, 1997.
124. V. Nedeljkovic, "A novel multilayer neural networks training algorithm that minimizes the probability of classification error," IEEE Trans. Neural Networks, vol. 4, pp. 650-659, 1993.
125. E. Oja, "Neural networks, principle components, and subspace," Int. J. Neural Syst., vol. 1, pp. 61-68, 1989.
126. A. Papoulix, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1965.
127. E. Patwo, M. Y. Hu, and M. S. Hung, "Two-group classification using neural networks," Decis. Sci., vol. 24, no. 4, pp. 825-845, 1993.
128. M. P. Perrone, "Putting it all together: Methods for combining neural networks," in Advances in Neural Information Processing Systems, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. San Mateo, CA: Morgan Kaufmann, 1994, vol. 6, pp. 1188-1189.
129. M. P. Perrone and L. N. Cooper, "When networks disagree: Ensemble methods for hybrid neural networks," in Neural Networks for Speech and Image Processing, R. J. Mammone, Ed. London, U.K.: Chapman & Hall, 1993, pp. 126-142.
130. T. Petsche, A. Marcantonio, C. Darken, S. J. Hanson, G. M. Huhn, and I. Santoso, "An autoassociator for on-line motor monitoring," in Industrial Applications of Neural Networks, F. F. Soulie and P. Gallinari, Eds, Singapore: World Scientific, 1998, pp. 91-97.
131. L. Prechelt, "A quantitative study of experimental evaluation of neural network algorithms: Current research practice," Neural Networks, vol. 9, no. 3, pp. 457-462, 1996.
132. S. J. Press and S. Wilson, "Choosing between logistic regression and discriminant analysis," J. Amer. Statist. Assoc., vol. 73, pp. 699-705, 1978.
133. M. Qi and G. S. Maddala, "Option pricing using ANN: The case of S&P 500 index call options," in Proc. 3rd Int. Conf. Neural Networks Capital Markets, 1995, pp. 78-91.
134. S. Raudys, "Evolution and generalization of a single neuron: I. Single-layer perceptron as seven statistical classifiers," Neural Networks, vol. II, pp. 283-296, 1998.
135. _, "Evolution and generalization of a single neurone: II. Complexity of statistical classifiers and sample size considerations," Neural Networks, vol. 11, pp. 297-313, 1998.
136. S. J. Raudys and A. K. Jain, "Small sample size effects in statistical pattern recognition: Recommendations for practitioners," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 252-264, Mar. 1991.
137. R. Reed, "Pruning algorithms - A survey," IEEE Trans. Neural Networks, vol. 4, pp. 740-747, Sept. 1993.
138. M. D. Richard and R. Lippmann, "Neural network classifiers estimate Bayesian a posteriori probabilities," Neural Comput., vol. 3, pp. 461-483, 1991.
139. A. Ripley, "Statistical aspects of neural networks," in Networks and Chaos - Statistical and Probabilistic Aspects, O. E. Barndorff-Nielsen, J. L. Jensen, and W. S. Kendall, Eds. London, U.K.: Chapman & Hall, 1993, pp. 40-123.
140. _, "Neural networks and related methods for classification," J. R. Statist. Soc. B, vol. 56, no. 3, pp. 409-456, 1994.
141. G. Rogova, "Combining the results of several neural network classifiers," Neural Networks, vol. 7, pp. 777-781, 1994.
142. A. Roy, L. S. Kim, and S. Mukhopadhyay, "A polynomial time algorithm for the construction and training of a class of multilayer perceptrons," Neural Networks, vol. 6, pp. 535-545, 1993.
143. D. W. Ruck, S. K. Rogers, M. Kabrisky, M. E. Oxley, and B. W. Suter, "The multilayer perceptron as an approximation to a Bayes optimal discriminant function," IEEE Trans. Neural Networks, vol. 1, no. 4, pp. 296-298, 1990.
144. D. E. Rumelhart, R. Durbin, R. Golden, and Y. Chauvin, "Backpropagation: The basic theory," in Backpropagation: Theory, Architectures, and Applications, Y. Chauvin and D. E. Rumelhart, Eds. Hillsdale, NJ: LEA, 1995, pp. 1-34.
145. S. L. Salzberg, "On comparing classifiers: Pitfalls to avoid and a recommended approach," Data Mining Knowl. Disc., vol. 1, pp. 317-328, 1997.
146. M. S. Sanchez and L. A. Sarabia, "Efficiency of multi-layered feed-forward neural networks on classification in relation to linear discriminant analysis, quadratic discriminant analysis and regularized discriminant analysis," Chemometr. Intell. Labor. Syst., vol. 28, pp. 287-303, 1995.
147. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Networks, vol. 2, pp. 459-473, 1989.
148. C. Schittenkopf, F. Deco, and W. Brauer, "Two strategies to avoid overfitting in feedforward networks," Neural Networks, vol. 10, pp. 505-516, 1997.
149. M. Schumacher, R. Robner, and W. Vach, "Neural networks and logistic regression: Part I," Comput. Statist. Data Anal., vol. 21, pp. 661-682, 1996.
150. T. K. Sen, R. Oliver, and N. Sen, "Predicting corporate mergers," in Neural Networks in the Capital Markets, A. P. Refenes, Ed. New York: Wiley, 1995, pp. 325-340.
151. I. Sethi and M. Otten, "Comparison between entropy net and decision tree classifiers," in Proc. Int. Joint Conf. Neural Networks, vol. 3, 1990, pp. 63-68.
152. R. Setiono and H. Liu, "Neural-network feature selector," IEEE Trans. Neural Networks, vol. 8, no. 3, pp. 654-662, 1997.
153. A. J. C. Sharkey, "Multi-net systems," in Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems, A. J. C. Sharkey, Ed. Berlin, Germany: Springer-Verlag, 1999, pp. 1-30.
154. A. J. C. Sharkey and N. E. Sharkey, "Combining diverse neural nets," Knowl. Eng. Rev., vol. 12, no. 3, pp. 231-247, 1997.
155. J. W. Shavlik, R. J. Mooney, and G. G. Towell, "Symbolic and neural learning algorithms: An empirical comparison," Mach. Learn., vol. 6, pp. 111-144, 1991.
156. P. A. Shoemaker, "A note on least-squares learning procedures and classification by neural network models," IEEE Trans. Neural Networks, vol. 2, pp. 158-160, 1991.
157. J. Sietsma and R. Dow, "Creating artificial neural networks that generalize," Neural Networks, vol. 4, pp. 67-79, 1991.
158. J. M. Steppe and K. W. Bauer, "Feature saliency measures," Comput. Math. Applicat., vol. 33, pp. 109-126, 1997.
159. _, "Improved feature screening in feedforward neural networks," Neurocomput., vol. 13, pp. 47-58, 1996.
160. J. M. Steppe, K. W. Bauer, and S. K. Rogers, "Integrated feature and architecture selection," IEEE Trans. Neural Networks, vol. 7, pp. 1007-1014, 1996.
161. V. Subramanian, M. S. Hung, and M. Y. Hu, "An experimental evaluation of neural networks for classification," Comput. Oper. Res., vol. 20, pp. 769-782, 1993.
162. A. H. Sung, "Ranking importance of input parameters of neural networks," Expert Syst. Applicat., vol. 15, pp. 405-411, 1998.
163. A. J. Surkan and J. C. Singleton, "Neural networks for bond rating improved by multiple hidden layers," in Proc. IEEE Int. Joint Conf. Neural Networks, vol. 2, San Diego, CA, 1990, pp. 157-162.
164. H. Szu, B. Telfer, and S. Kadambe, "Neural network adaptive wavelets for signal representation and classification," Opt. Eng., vol. 31, no. 9, pp. 1907-1916, 1992.
165. H. Szu, X. Y. Yang, B. Telfer, and Y. Sheng, "Neural network and wavelet transform for scale-invariant data classification," Phys. Rev., vol. 48, no. 2, pp. 1497-1501, 1994.
166. H. Szu, B. Telfer, and J. Garcia, "Wavelet transforms and neural networks for compression and recognition," Neural Networks, vol. 9, pp. 695-708, 1996.
167. K. Y. Tam and M. Y. Kiang, "Managerial application of neural networks: The case of bank failure predictions," Manage. Sci., vol. 38, no. 7, pp. 926-947, 1992.
168. R. Tibshirani, "Bias, variance and prediction error for classification rules," Dept. Statist., Univ. Toronto, Toronto, ON, Canada, Tech. Rep., 1996.
169. A. B. Tickle, R. Andrews, M. Golea, and J. Diederich, "The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks," IEEE Trans. Neural Networks, vol. 9, pp. 1057-1068, 1998.
170. G. T. Toussaint, "Bibliography on estimation of misclassification," IEEE Trans. Inform. Theory, vol. IT-20, pp. 472-479, 1974.
171. K. Turner and J. Ghosh, "Analysis of decision boundaries in linearly combined neural classifiers," Pattern Recognit., vol. 29, no. 2, pp. 341-348, 1996.
172. _, "Error correlation and error reduction in ensemble classifiers," Connect. Sci., vol. 8, pp. 385-404, 1996.
173. _, "Classifier combining through trimmed means and order statistics," IEEE Int. Conf. Neural Networks, pp. 695-700, 1998.
174. J. Utans and J. Moody, "Selecting neural network architecture via the prediction risk: Application to corporate bond rating prediction," in Proc. 1st Int. Conf. Artificial Intelligence Applications Wall Street, 1991, pp. 35-41.
175. P. E. Utgoff, "Perceptron trees: A case study in hybrid concept representation," Connect. Sci., vol. 1, pp. 377-391, 1989.
176. W. Vach, R. Robner, and M. Schumacher, "Neural networks and logistic regression: Part II," Comput. Statist. Data Anal., vol. 21, pp. 683-701, 1996.
177. B. L. Victor and G. P. Zhang, "The effect of misclassification costs on neural network classifiers," Decision Sci., vol. 30, pp. 659-682, 1999.
178. E. Wan, "Neural network classification: A Bayesian interpretation," IEEE Trans. Neural Networks, vol. 1, no. 4, pp. 303-305, 1990.
179. S. Wang, "The unpredictability of standard back propagation neural networks in classification applications," Manage. Sci., vol. 41, no. 3, pp. 555-559, 1995.
180. Z. Wang, C. D. Massimo, M. T. Tham, and A. J. Morris, "A procedure for determining the topology of multilayer feedforward neural networks," Neural Networks, vol. 7, pp. 291-300, 1994.
181. A. R. Webb and D. Lowe, "The optimized internal representation of multilayer classifier networks performs nonlinear discriminant analysis," Neural Networks, vol. 3, no. 4, pp. 367-375, 1990.
182. A. Weigend, D. Rumelhart, and B. Huberman, "Predicting the future: A connectionist approach," Int. J. Neural Syst., vol. 3, pp. 193-209, 1990.
183. A. Weigend, "On overfitting and the effective number of hidden units," in Proc. 1993 Connectionist Models Summer School, P. Smolensky, D. S. Touretzky, J. L. Elman, and A. S. Weigend, Eds. Hillsdale, NJ, 1994, pp. 335-342.
184. S. M. Weiss and C. A. Kulilowski, Computer Systems that Learn. San Mateo, CA: Morgan Kaufmann, 1991.
185. H. White, "Learning in artificial neural networks: A statistical perspective," Neural Comput., vol. 1, pp. 425-464, 1989.
186. B. Widrow, D. E. Rumelhard, and M. A. Lehr, "Neural networks: Applications in industry, business and science," Commun. ACM, vol. 37, pp. 93-105, 1994.
187. R. L. Wilson and R. Sharda, "Bankruptcy prediction using neural networks," Decision Support Syst., vol. 11, pp. 545-557, 1994.
188. H. Wolpert, "On the connection between in-sample testing and generalization error," Complex Syst., vol. 6, pp. 47-94, 1992.
189. _, "Stacked generalization," Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.
190. _, "On bias plus variance," Neural Comput., vol. 9, pp. 1211-1243, 1997.
191. L. Xu, "Recent advances on techniques of static feedforward networks with supervised learning," Int. J. Neural Syst., vol. 3, no. 3, pp. 253-290, 1992.
192. L. Xu, A. Krzyzak, and C. Y. Suen, "Methods of combing multiple classifiers and their applications to handwriting recognition," IEEE Trans. Syst., Man, Cybern., vol. 22, pp. 418-435, 1992.
193. Y. Yoon, G. Swales, and T. M. Margavio, "A comparison of
194. J.-L. Yuan and T. L. Fine, "Neural-network design for small training sets of high dimension," IEEE Trans. Neural Networks, vol. 9, pp. 266-280, 1998.
195. G. Zhang, M. Y. Hu, E. B. Patuwo, and D. Indro, "Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis," Eur. J. Oper. Res., vol. 116, pp. 16-32, 1999.
196. Q. Zhang and A. Benveniste, "Wavelet networks," IEEE Trans. Neural Networks, vol. 3, pp. 889-898, 1992.