Using neural networks for data mining

Future Generation Computer Systems

Volumn 13, Issue 2-3, 1997, Pages 211-229

  Craven, Mark W ^a   Shavlik, Jude W ^b  

^a Carnegie Mellon University ^*  (United States)

^b University of Wisconsin Madison ^*  (United States)

Author keywords

Comprehensible models; Decision trees; Machine learning; Neural networks; Perceptions; Rule extraction

Indexed keywords

DATA ACQUISITION; DATABASE SYSTEMS; DECISION THEORY; KNOWLEDGE BASED SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; TREES (MATHEMATICS);

DATA MINING; RULE EXTRACTION;

NEURAL NETWORKS;

EID: 0031270141     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0167-739x(97)00022-8     Document Type: Article

References (21)

1. R. Andrews, J. Diederich and A.B. Tickle, A survey and critique of techniques for extracting rules from trained artificial neural networks, Knowledge-Based Syst. 8 (6) (1995).
2. C.M. Bishop, Neural Networks for Pattern Recognition (Oxford University Press, Oxford, UK, 1996).
3. L. Breiman, J. Friedman, R. Olshen and C. Stone, Classification and Regression Trees (Wadsworth and Brooks, Monterey, CA, 1984).
4. M.W. Craven, Extracting comprehensible models from trained neural networks, Ph.D. Thesis, Computer Sciences Department, University of Wisconsin, Madison, WI, 1996; available as CS Technical Report 1326; available by WWW as ftp://ftp.cs.wisc.edu/machine-learning/shavlik-group/craven.thesis.ps.Z.
5. M. Craven and J. Shavlik, Learning symbolic rules using artificial neural networks, in: Proc. 10th Internat. Conf. on Machine Learning, Amherst, MA (Morgan Kaufmann, Los Altos, CA, 1993) 73-80.
6. M.W. Craven and J.W. Shavlik, Extracting tree-structured representations of trained networks, in: Advances in Neural Information Processing Systems, eds. D. Touretzky, M. Mozer and M. Hasselmo, Vol. 8 (MIT Press, Cambridge, MA, 1996).
7. Y. Freund and R.E. Schapire, Experiments with a new boosting algorithm, in: Proc. 13th Internat. Conf. on Machine Learning, Bari, Italy (Morgan Kaufmann Los Altos, CA, 1996) 148-156.
8. L. Fu, Rule learning by searching on adapted nets, in: Proc. 9th National Conf. on Artificial Intelligence, Anaheim, CA (AAAI, Menlo Park, CA/MIT Press, Cambridge, MA, 1991) 590-595.
9. S.I. Gallant, Neural Network Learning and Expert Systems (MIT Press, Cambridge, MA, 1993).
10. C.L. Giles, C.B. Miller, D. Chen, H.H. Chen, G.Z. Sun and Y.C. Lee, Learning and extracting finite state automata with second-order recurrent neural networks, Neural Comput. 4 (1992) 393-405.
11. J.C. Jackson and M.W. Craven, Learning sparse perceptrons, in: Advances in Neural Information Processing Systems, eds. D. Touretzky, M. Mozer and M. Hasselmo, Vol. 8 (MIT Press, Cambridge, MA, 1996).
12. T. Kohonen, Self-Organizing Maps (Springer, Berlin, 1995).
13. S. Lawrence, C.L. Giles and A.C. Tsoi, Symbolic conversion, grammatical inference and rule extraction for foreign exchange rate prediction, in: Neural Networks in the Capital Markets, eds. Y. Abu-Mostafa, A.S. Weigend and P.N. Refenes (World Scientific, Singapore, 1997).
14. J. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann, San Mateo, CA, 1993).
15. D.E. Rumelhart and D. Zipser, Feature discovery by competitive learning, Cognitive Sci. 9 (1985) 75-112.
16. K. Saito and R. Nakano, Medical diagnostic expert system based on PDP model, in: Proc. IEEE Internat. Conf. on Neural Networks, San Diego, CA (IEEE Press, New York, 1988) 255-262.
17. I.K. Sethi and J.H. Yoo, Symbolic approximation of feedforward neural networks, in: Pattern Recognition in Practice, eds. E.S. Gelsema and L.N. Kanal, Vol. 4 (North-Holland, New York, 1994).
18. J. Shavlik, R. Mooney and G. Towell, Symbolic and neural net learning algorithms: An empirical comparison, Mach. Learning 6 (1991) 111-143.
19. S. Thrun, Extracting rules from artificial neural networks with distributed representations, in: Advances in Neural Information Processing Systems, eds. G. Tesauro, D. Touretzky and T. Leen, Vol. 7 (MIT Press, Cambridge, MA 1995).
20. G. Towell and J. Shavlik, Extracting refined rules from knowledge-based neural networks, Mach. Learning 13 (1) (1993) 71-101.
21. B. Widrow, D.E. Rumelhart and M.A. Lehr, Neural networks: Applications in industry, business, and science, Commun. ACM 37 (3) (1994) 93-105.