Minerva: Sequential covering for rule extraction

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 2, 2008, Pages 299-309

  Huysmans, Johan ^a   Setiono, Rudy ^b   Baesens, Bart ^a,c,d   Vanthienen, Jan ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c VLERICK BUSINESS SCHOOL   (Belgium)

^d UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Classification; Rule extraction; Support vector machines

Indexed keywords

ALGORITHMS; NEURAL NETWORKS; SUPPORT VECTOR MACHINES;

BLACK-BOX MODEL; RULE EXTRACTION;

LEARNING SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; DECISION SUPPORT SYSTEM; INFORMATION RETRIEVAL; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DECISION SUPPORT TECHNIQUES; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED;

EID: 41649093790     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2007.912079     Document Type: Article

References (34)

1. B. Baesens, T. Van Gestel, S. Viaene, M. Stepanova, J. Suykens, and J. Vanthienen, "Benchmarking state-of-the-art classification algorithms for credit scoring," J. Oper. Res. Soc., vol. 54, no. 6, pp. 627-635, 2003.
2. N. Barakat and J. Diederich, "Eclectic rule-extraction from support vector machines," Int. J. Comput. Intell., vol. 2, no. 1, pp. 59-62, 2005.
3. G. Fung, S. Sandilya, and R. Rao, "Rule extraction from linear support vector machines," in Proc. 11th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2005, pp. 32-40.
4. R. Setiono, W. Leow, and J. Zurada, "Extraction of rules from artificial neural networks for nonlinear regression," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 564-577, May 2002.
5. I. Taha and J. Ghosh, "Symbolic interpretation of artificial neural networks," IEEE Trans. Knowl. Data Eng., vol. 11, no. 3, pp. 448-463, May/Jun. 1999.
6. K. Saito and R. Nakano, "Law discovery using neural networks," in Proc. 15th Int. Joint Conf. Artif. Intell., 1997, pp. 1078-1083.
7. R. Setiono and J. Thong, "An approach to generate rules from neural networks for regression problems," Eur. J. Oper. Res., vol. 155, no. 1, pp. 239-250, May 2004.
8. S. Thrunin "Extracting provably correct rules from artificial neural networks," Univ. Bonn, Inst. Informatik III, Bonn, Germany, Tech. Rep. IAI-TR-93-5, 1993. [Online]. Available: Citeseer.ifi.unizh.ch/ thrun93extracting.html
9. R. Andrews, J. Diederich, and A. Tickle, "Survey and critique of techniques for extracting rules from trained artificial neural networks," Knowl.-Based Syst., vol. 8, no. 6, pp. 373-389, Dec. 1995.
10. L. Breiman, J. Friedman, R. Olsen, and C. Stone, Classification and Regression Trees. Wadsworth and Brooks, 1984.
11. J. Quinlan, C4.5: Programs for Machine Learning. San Francisco, CA: Morgan Kaufmann, 1993.
12. N. Barakat and J. Diederich, "Learning-based rule-extraction from support vector machines," in Proc. 14th ICCTA, 2004.
13. M. Craven, "Extracting comprehensible models from trained neural networks," Ph.D. dissertation, Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, WI, 1996.
14. M. Craven and J. Shavlik, "Extracting tree-structured representations of trained networks," in Advances in Neural Information Processing Systems, vol. 8, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds. Cambridge, MA: MIT Press, 1996, pp. 24-30. [Online]. Available: citeseer.ist.psu.edu/craven96extracting.html
15. D. Silverman, Density Estimation for Statistics and Data Analysis. London, U.K.: Chapman & Hall, 1986.
16. J. Huysmans, B. Baesens, and J. Vanthienen, "ITER: An algorithm for predictive regression rule extraction," in Proc. 8th Int. Conf. DaWaK, 2006, vol. 4081, pp. 270-279.
17. P. Clark and T. Niblett, "The CN2 induction algorithm," Mach. Learn., vol. 3, no. 4, pp. 261-283, Mar. 1989. [Online]. Available: citeseer.ist. psu.edu/clark89cn.html
18. R. Michalski, "On the quasi-minimal solution of the general covering problem," in Proc. 5th Int. Symp. Inf. Process. (FCIP), 1969, pp. 125-128.
19. W. Cohen, "Fast effective rule induction," in Proc. 12th Int. Conf. Mach. Learn., A. Prieditis and S. Russell, Eds., 1995, pp. 115-123.
20. D. Newman, S. Hettich, C. Blake, and C. Merz, UCI Repository of Machine Learning Databases. Irvine, CA: Univ. California, Dept. Inf. and Comput. Sci., 1998.
21. J. Suykens, T. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle, Least Squares Support Vector Machines. Singapore: World Scientific, 2002.
22. B. Baesens, "Developing intelligent systems for credit scoring using machine learning techniques," Ph.D. dissertation, Katholieke Univ. Leuven, Faculteit Economische en Toegepaste Economische Wetenschappen, Leuven, Belgium, 2003.
23. J. Neumann, "Classification and evaluation of algorithms for rule extraction from artificial neural networks," Ph.D. dissertation, Univ. Edinburgh, Edinburgh, U.K., 1998. Summer Project.
24. T. Etchells and P. Lisboa, "Orthogonal search-based rule extraction (OSRE) for trained neural networks: A practical and efficient approach," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 374-384, Mar. 2006.
25. E. Saad and D. Wunsch, "Neural network explanation using inversion," Neural Netw., vol. 20, no. 1, pp. 78-93, Jan. 2007.
26. G. Schmitz, C. Aldrich, and F. Gouws, "ANN-DT: An algorithm for extraction of decision trees from artificial neural networks," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1392-1401, Nov. 1999.
27. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
28. B. Schölkopf, C. Burges, and A. Smola, Advances in Kernel Methods-Support Vector Learning. Cambridge, MA: MIT Press, 1998.
29. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
30. J. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Process. Lett., vol. 9, no. 3, pp. 293-300, Jun. 1999.
31. J. Suykens, L. Lukas, P. Van Dooren, B. De Moor, and J. Vandewalle, "Least squares support vector machine classifiers: A large scale algorithm," in Proc. 14th ECCTD, 1999, pp. 839-842.
32. J. Suykens and J. Vandewalle, "Multiclass least squares support vector machines," in Proc. IJCNN, 1999, pp. 900-903.
33. C. Bishop, Neural Networks for Pattern Recognition. London, U.K.: Oxford Univ. Press, 1995.
34. J. Suykens, L. Lukas, and J. Vandewalle, "Sparse least squares support vector machine classifiers," in Proc. 8th ESANN, 2000, pp. 37-42.