A comparison of gradient ascent, gradient descent and genetic-algorithm- based artificial neural networks for the binary classification problem

Expert Systems

Volumn 24, Issue 2, 2007, Pages 65-86

  Pendharkar, Parag C ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Artificial intelligence; Decision support systems; Genetic algorithms; Neural networks

Indexed keywords

BINARY SEQUENCES; CLASSIFICATION (OF INFORMATION); ERROR CORRECTION; GENETIC ALGORITHMS; GRADIENT METHODS; PROBLEM SOLVING;

BINARY CLASSIFICATION PROBLEM; DATA SETS; OVERFIT TRAINING DATA; ROOT-MEAN-SQUARE ERROR MINIMIZING;

NEURAL NETWORKS;

EID: 34247180155     PISSN: 02664720     EISSN: 14680394     Source Type: Journal    
DOI: 10.1111/j.1468-0394.2007.00421.x     Document Type: Review

References (33)

1. BENEDICT, P.A. (1990) The use of synthetic data in dynamic bias selection, Proceedings of the 6th Aerospace Applications of Artificial Intelligence Conferences, Dayton, Ohio, 34-42.
2. BHATTACHARYYA, S. and P.C. PENDHARKAR (1998) Inductive, evolutionary and neural techniques for discrimination: a comparative study, Decision Sciences, 29, 871-900.
3. FENSTERSTOCK, A. (2001) Credit scoring: the application of neural networks to credit scoring, Business Credit, 103(3), 58-61.
4. GOLDBERG, D.E. and K. DEB (1991) A comparative analysis of selection schemes used in genetic algorithms, in Foundations of Genetic Algorithms, G. Rawlins (ed.), San Mateo, CA: Morgan Kaufmann, 69-93.
5. HAN, J. and M. KAMBER (2001) Data Mining: Concepts and Techniques, San Francisco, CA: Morgan Kaufmann.
6. HUANG, W.Y. and R.P. LIPPMANN (1987) Comparisons between neural net and conventional classifiers, IEEE 1st International Conference on Neural Networks, New York: IEEE, 485-493.
7. JOACHIMSTHALER, E.A. and A. STAM (1988) Four approaches to the classification problem in discriminant analysis: an experimental study, Decision Sciences, 19, 322-333.
8. KOEHLER, G.J. (1991) Linear discriminant functions determined by genetic search, ORSA Journal on Computing, 3, 345-357.
9. KOLDA, T.G., R.M. LEWIS and V. TORCZON (2003) Optimization by direct search: new perspectives on some classical and modern methods, SIAM Review, 45 (3), 385-482.
10. KRAMER, M.A. (1991) Nonlinear principal component analysis using autoassociative neural networks, AI and Chemical Engineering Journal, 37 (2), 233-243.
11. KUMAR, A. (1999) A study of composite or hybrid classifiers for knowledge discovery, INFORMS Journal on Computing, 11, 267-277.
12. LIPPMANN, R.P. (1987) An introduction to computing with neural nets, IEEE ASSP Magazine, 4, 2-22.
13. MAHMOOD, M.A., G.L. SULLIVAN and R.L. TUNG (1999) A new approach to evaluation business ethics: an artificial neural networks application, Journal of End User Computing, 11 (3), 11-20.
14. MANGASARIAN, O.L. (1993) Mathematical programming in neural networks, ORSA Journal on Computing, 43, 349-360.
15. MEG, M. (1998) The smart machines, Chief Information Officer, 11 (23), 88.
16. MITCHELL, T.M. (1997) Machine Learning, New York, NY: McGraw Hill.
17. PATUWO, E., M.Y. HU and M.S. HUNG (1993) Two group classification using neural networks, Decision Sciences, 24 (4), 825-846.
18. PENDHARKAR, P.C. (2001) An empirical study of design and testing of hybrid evolutionary-neural approach for classification, Omega: An International Journal of Management Science, 29, 361-374.
19. PENDHARKAR, P.C. (2002) A computational study on the performance of ANNs under changing structural design and data distributions, European Journal of Operational Research, 138, 155-177.
20. PENDHARKAR, P.C. (2005a) Hybrid approaches for classifications under information acquisition cost constraint, Decision Support Systems and Electronic Commerce, 41, 228-241.
21. PENDHARKAR, P.C. (2005b) A threshold-varying artificial neural network approach for classification and its application to bankruptcy prediction problem, Computers and Operations Research, 32, 2561-2582.
22. PENDHARKAR, P.C. and S. NANDA (2006) A misclassification cost minimizing evolutionary-neural classification approach, Naval Research Logistics, 53 (5), 432-447.
23. PENDHARKAR, P.C. and J.A. RODGER (2000) A nonlinear programming and genetic search application for production scheduling in coal mines, Annals of Operations Research, 95, 251-267.
24. PENDHARKAR, P.C. and J.A. RODGER (2004) An empirical study of impact of crossover operators on the performance of non-binary genetic algorithm based neural approaches for classification, Computers and Operations Research, 31, 481-498.
25. PENDHARKAR, P.C., J.A. RODGER, G.J. YAVERBAUM, N. HERMAN and M. BRENNER (1999) Association, statistical, mathematical and neural approaches for learning and predicting breast cancer patterns, Expert Systems with Applications, 17, 223-232.
26. SCHALKOFF, R.J. (1997) Artificial Neural Networks, New York, NY: McGraw Hill.
27. SEXTON, R.S., B. ALLIDAE, R.E. DORSEY and J.D. JOHNSON (1998) Global optimization of artificial neural networks: a tabu search application, European Journal of Operational Research, 106, 570-584.
28. SEXTON, R.S., R.E. DORSEY and J.D. JOHNSON (1999) Optimization of neural networks: a comparative analysis of the genetic algorithms and simulated annealing, European Journal of Operational Research, 114, 589-601.
29. SUBRAMANIAN, V. and M.S. HUNG (1990) A GRG2 based system for training neural networks: design and computational experience, ORSA Journal on Computing, 5, 386-394.
30. VALE, C.D. and V.A. MAURELLI (1983) Simulating multivariate non-normal distributions, Psvchometrika, 48, 465-471.
31. VAPNIK, V. (1995) Statistical Learning Theory, New York: Springer.
32. WU, C. and X.M. WANG (2000) A neural network approach for analyzing small business lending decisions, Review of Quantitative Finance and Accounting, 15 (3), 259-261.
33. ZAITZ, J. (1998) Learning target marketing, Telephony, 234 (4), 70-72.