An approach to generate rules from neural networks for regression problems

European Journal of Operational Research

Volumn 155, Issue 1, 2004, Pages 239-250

  Setiono, Rudy ^a   Thong, James Y L ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Curve fitting; Knowledge based systems; Machine learning; Neural networks; Nonlinear regression

Indexed keywords

CURVE FITTING; KNOWLEDGE ACQUISITION; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; LINEAR EQUATIONS; NEURAL NETWORKS; OPERATIONS RESEARCH; PROBLEM SOLVING;

CLASSIFICATION PROBLEMS; NON-LINEAR MAPPING;

REGRESSION ANALYSIS;

EID: 0346279920     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0377-2217(02)00792-0     Document Type: Article

References (27)

1. C. Blake, C.J. Merz, UCI repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, 1998. Available from 〈 http://www.ics.uci.edu/̃mlearn/MLRepository.html〉.
2. Coakley J.R., Brown C.E. Artificial neural networks applied to ratio analysis in the analytical review process. Intelligent Systems in Accounting, Finance and Management. 2:1993;19-39.
3. Cybenko G. Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals, and Systems. 2:1989;303-314.
4. Dennis J.E. Jr., Schnabel R.E. Numerical Methods for Unconstrained Optimization and Nonlinear Equations. 1983;Prentice Hall, Englewood Cliffs, NJ.
5. Desai V.S., Bharati R. The efficacy of neural networks in predicting returns on stock and bond indices. Decision Sciences. 29(2):1998;527-544.
6. Dutta S., Shekhar S., Wong W.Y. Decision support in non-conservative domains: Generalization with neural networks. Decision Support Systems. 11(5):1994;527-544.
7. Ein-Dor P., Feldmesser J. Attributes of the performance of central processing units: A relative performance prediction model. Communications of the ACM. 30(4):1987;308-317.
8. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks. 4:1991;251-257.
9. G. John, R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, in: Proceedings of the 11th International Conference on Machine Learning, Morgan Kaufman, San Mateo, 1994, pp. 121-129.
10. W. Khattree, D.N. Naik, Applied multivariate statistics with SAS software, SAS Institute, Carey, NC, 1999.
11. Kilpatrick D., Cameron-Jones M. Numeric prediction using instance-based learning with encoding length selection. Progress in connectionist-based information systems. 1998;Springer-Verlag, Singapore.
12. M.-C. Ludl, G. Widmer, Relative unsupervised discretization for regression problems, in: R.A. Mantaras, E. Plaza (Eds.), Proceedings of the 11th European Conference on Machine Learning, ECML 2000, Lecture Notes in AI 1810, Springer, Barcelona, 2000, pp. 246-253.
13. Quinlan R. C4.5: Programs for machine learning. 1993;Morgan Kaufman, San Mateo, CA.
14. Rumelhart D.E., Hinton G.E., Williams R.J. Learning internal representations by error propagation. Rumelhart D.E., McCleland J.L. Parallel Distributed Processing: Explorations in the Microstructures of Cognition. vol. 1:1986;318-362 The MIT Press, Cambridge, MA.
15. Salchenberger L.M., Cinar E.M., Lash N.A. Neural networks: A new tool for predicting thrift failures. Decision Sciences. 23(4):1992;899-916.
16. Setiono R. A penalty function approach for pruning feedforward neural networks. Neural Computation. 9(1):1997;185-204.
17. Setiono R., Azcarraga A. Generating concise sets of linear regression rules from artificial neural networks. International Journal of Artificial Intelligence Tools. 11(2):2002;189-202.
18. R. Setiono, W.K. Leow, Pruned neural networks for regression, in: R. Mizoguchi, J. Slaney (Eds.), Proceedings of the 6th Pacific Rim Conference on Artificial Intelligence, PRICAI 2000, Lecture Notes in AI 1886, Springer, Melbourne, 2000, pp. 500-509.
19. Setiono R., Leow W.K., Zurada J. Extraction of rules from artificial neural networks for nonlinear regression. IEEE Transactions on Neural Networks. 13(3):2002;564-577.
20. Tam K.Y., Kiang M.Y. Managerial applications of neural networks: The case of bank failure predictions. Management Science. 38(7):1992;926-948.
21. Tana S.S., Koh H.C. A multi-layer perceptron model of credit scoring for assessing default risk in charge card applicants. International Journal of Management. 14(2):1992;250-255.
22. Tickle A.B., Andrews R., Golea M., Diederich J. The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks. IEEE Transactions on Neural Networks. 9(6):1998;1057-1068.
23. L. Torgo, Functional models for regression tree leaves, in: D. Fisher (Ed.), Proceedings of the International Conference on Machine Learning, ICML-97, Morgan Kaufman, San Mateo, CA, 1997.
24. L. Torgo, J. Gama, Search-based class discretization, in: M. van Someren, G. Widmer (Eds.), Proceedings of the Ninth European Conference on Machine Learning, ECML-97, Lecture Notes in AI 1224, Springer, Prague, 1997, pp. 266-273.
25. Trippi R.R., Turban E. Neural Networks in Finance and Investing. 1993;Probus Publishing Company, Chicago.
26. Villiers J., Barnard E. Backpropagation neural nets with one and two hidden layers. IEEE Transactions on Neural Networks. 4(1):1993;136-141.
27. Wilson R.L., Sharda R. Bankruptcy prediction using neural networks. Decision Support Systems. 11(5):1994;545-557.