SRI: A scalable rule induction algorithm

Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science

Volumn 220, Issue 4, 2006, Pages 537-552

  Pham, D T ^a   Afify, A A ^a  

^a CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Classification learning; Data mining; Inductive learning; Knowledge discovery; Machine learning; Noise handling; Rule induction

Indexed keywords

ALGORITHMS; COMPUTATION THEORY; DATA MINING; DATA REDUCTION; LEARNING SYSTEMS; MATHEMATICAL MODELS;

CLASSIFICATION LEARNING; INDUCTIVE LEARNING; KNOWLEDGE DISCOVERY; NOISE HANDLING; RULE INDUCTION;

KNOWLEDGE BASED SYSTEMS;

ALGORITHMS; COMPUTATION THEORY; DATA MINING; DATA REDUCTION; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; MATHEMATICAL MODELS;

EID: 33845692762     PISSN: 09544062     EISSN: None     Source Type: Journal    
DOI: 10.1243/09544062C18304     Document Type: Article

References (61)

1. Fayyad, U. M., Piatetsky-Shapiro, G., and Smyth, P. From data mining to knowledge discovery: An overview. In Advances in knowledge discovery and data mining (Eds U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy), AAAI Press, Menlo Park, CA.
2. Braha, D. Data mining for design and manufacturing: methods and applications, 2001 (Kluwer Academic Publishers, Boston).
3. Monostori, L. AI and machine learning techniques for managing complexity, changes and uncertainties in manufacturing. Proceedings of the 15th Triennial World Congress, Barcelona, Spain, 2002, pp. 119-130.
4. Pham, D. T. and Afify, A. A. Machine-learning techniques and their applications in manufacturing. Proc. IMechE, Part B: J. Engineering Manufacture, 2005, 219(B5), 395-412.
5. Apté, C. and Weiss, S. Data mining with decision trees and decision rules. Future Gener. Comp. Sys., 1997, 13, 197-210.
6. Pham, D. T. and Afify, A. A. Machine learning: techniques and trends. Proceedings of the 9th International Workshop on Systems, signals and image processing (IWSSIP - 02), 2002, pp. 12-36 (World Scientific, Manchester, Town Hall, UK).
7. Fayyad, U. M., Haussler, D., and Stolorz, P. KDD for science data analysis: Issues and examples. Proceedings of the 2nd International Conference on Data mining and knowledge discovery, 1996, pp. 50-56 (AAAI Press, Menlo Park, CA).
8. Fayyad, U. M., Piatetsky-Shapiro, G., and Smyth, P. Knowledge discovery and data mining: towards a unifying framework. Proceedings of the 2nd International Conference on Data mining and knowledge discovery, 1996, pp. 82-88 (AAAI Press, Menlo Park, CA).
9. Mitchell, T. M. Machine learning and data mining. Commun. ACM, 1999, 42(11), 31-36.
10. Provost, F. and Kolluri, V. A survey of methods for scaling up inductive algorithms. Data Min. Knowl. Disc., 1999, 2, 1-42.
11. Klösgen, W. and Zytkow, J. M. Handbook of data mining and knowledge discovery, 2002 (Oxford University Press, New York).
12. Ye, N. and Li, X. A scalable incremental learning algorithm for classification problems. Comput Ind. Eng., 2002, 43, 677-692.
13. Blockeel, H. and Sebag, M. Scalability and efficiency in multi-relational data mining. ACM SIGKDD Explor. Newslett., 2003, 5(1), 17-30.
14. Mehta, M., Agrawal, R., and Rissanen, J. SLIQ: a fast scalable classifier for data mining. Proceedings of the 5th International Conference on Extending database technology, 1996, pp. 18-32 (Avignon, France).
15. Shafer, J., Agrawal, R., and Mehta, M. SPRINT: a scalable parallel classifier for data mining. Proceedings of the 22nd International Conference on Very large data bases (VLDB), 1996, pp. 544-555 (Mumbai (Bombay), India).
16. Rastogi, R. and Shim, K. PUBLIC: a decision tree classifier that integrates building and pruning. Proceedings of the 24th International Conference on Very large data bases (VLDB), 1998, pp. 404-415 (New York, USA).
17. RuleQuest. Data mining tools C5.0. Pty Ltd, 30 Athena Avenue, St Ives NSW 2075, Australia, available from http://www.rulequest.com/see5-info.html, accessed 1 February 2003.
18. Pagallo, G. and Haussler, D. Boolean feature discovery in empirical learning. Mach. Learn., 1990, 3, 71-99.
19. Cendrowska, J. PRISM: an algorithm for inducing modular rules. Int. J. Man Mach. Stud., 1987, 27, 349-370.
20. Quinlan, J. R. Learning efficient classification procedures and their application to chess endgames. In Machine learning: an artificial intelligence approach (Eds R. S. Michalski, J. G. Carbonell, and T. M. Mitchell) 1983, vol. I, pp. 463-482 (Tioga Publishing Co., Palo Alto, CA).
21. Michalski, R. S. On the quasi-minimal solution of the general covering problem. Proceedings of the 5th International Symposium on Information processing (FCIP 69), 1969, A3 (Switching Circuits), pp. 125-128 (Bled, Yugoslavia).
22. Michalski, R. S. and Larson, J. B. Incremental generation of VL1 hypotheses: the underlying methodology and the descriptions of program AQ11. ISG 83-5, Department of Computer Science, University of Illinois at Urbana-Champaign, Urbana, Illinois, 1983.
23. Michalski, R. S., Mozetic, I., Hong, J., and Lavrac, N. The multi-purpose incremental learning system AQ15 and its testing application to three medical domains. American association of artificial intelligence, 1986, pp. 1041-1045 (Morgan Kaufmann, Los Altos, CA).
24. Michalski, R. S. and Kaufman, K. A. The AQ19 system for machine learning and pattern discovery: a general description and user guide, Reports of the machine learning and inference laboratory MLI 01-2, George Mason University, Fairfax, VA, USA, 2001.
25. Cervone, G., Panait, L. A., and Michalski, R. S. The development of the AQ20 learning system and initial experiments. Proceedings of the 10th International Symposium on Intelligent information systems, Zakopane, Poland, 2001.
26. Clark, P. and Niblett, T. The CN2 induction algorithm. Mach. Learn., 1989, 3(4), 261-284.
27. Clark, P. and Boswell, R. Rule induction with CN2: Some recent improvements. Proceedings of the 5th European Conference on Artificial intelligence, Porto, Portugal, 1991, 151-163.
28. Pham, D. T. and Aksoy, M. S. An algorithm for automatic rule induction! Artif. Intell. Eng., 1993, 227-282.
29. Pham, D. T. and Aksoy, M. S. RULES: A simple rule extraction system. Expert Syst. Appl., 1995, 8(1), 59-65.
30. Pham, D. T. and Aksoy, M. S. A new algorithm for inductive learning. J. Syst. Eng., 1995, 5, 115-122.
31. Pham, D. T. and Dimov, S. S. An efficient algorithm for automatic knowledge acquisition. Pattern Recogn., 1997, 30(7), 1137-1143.
32. Pham, D. T. and Dimov, S. S. An algorithm for incremental inductive learning. Proc. Instn Mech. Engrs, Part B: J. Engineering Manufacture, 1997, 211, 239-249.
33. Pham, D. T., Bigot, S., and Dimov, S. S. RULES-5: A rule induction algorithm for problems involving continuous attributes. Proc. Instn Mech. Engrs, Part C: J. Mechanical Engineering Science, 2003, 217, 1273-1286.
34. Pham, D. T. and Afify, A. A. RULES-6: A simple rule induction algorithm for handling large data sets. Submitted to Proc. IMechE, Part C: J. Mechanical Engineering Science, 2005, 219(C10), 1119-1137.
35. Domingos, P. A unified approach to concept learning. PhD Thesis, University of California, Irvine, 1997.
36. Weiss, G. M. and Hirsh, H. A quantitative study of small disjuncts. Proceedings of the 17th National Conference on Artificial intelligence, Austin, Texas, 2000, 665-670.
37. Afify, A. A. Design and analysis of scalable rule induction systems. PhD Thesis, University of Wales Cardiff, School of Engineering, Systems Engineering Division, Cardiff, UK, 2004.
38. Fayyad, U. M. and Irani, K. B. Multi-interval discretization of continuous-valued attributes for classification. Proceedings of the 13th International Joint Conference on Artificial intelligence, Chambery, France, 1993, 1022-1027.
39. Mitchell, T. M. The need for biases in learning generalizations, Technical report CBM-TR-117, Rutgers University, 1980.
40. Webb, G. Systematic search for categorical attribute-value data-driven machine learning. In AI'94- Proceedings of the 6th Australian Joint Conference on Artificial intelligence (Eds C. Rowles, H. Liu, and N. Foo), 1993, pp. 342-347 (World Scientific, Melbourne).
41. Quinlan, J. R. and Cameron-Jones, R. M. Over-searching and layered search in empirical learning. Proceedings of the 14th International Joint Conference on Artificial intelligence, Montreal, Quebec, Canada, 1995, 1019-1024.
42. Fürnkranz, J. Separate-and-conquer rule learning. Artif. Intelli. Rev., 1999, 13(1), 3-54.
43. Weiss, S. and Indurkhya, N. Reduced complexity rule induction. Proceedings of the 12th International Joint Conference on Artificial intelligence, Sydney, Australia, Morgan Kaufmann, 1991.
44. Cohen, W. W. Fast effective rule induction. Proceedings of the 12th International Conference on Machine learning, Tahoe City, CA, 1995, 115-123.
45. Fürnkranz, J. and Widmer, G. Incremental reduced error pruning. Proceedings of the 11th International Conference on Artificial intelligence, Amsterdam, The Netherlands, 1994, 453-457.
46. Muggleton, S. Foundations of inductive logic programming, 1995 (Prentice Hall, Englewood Cliffs, NJ).
47. Webb, G. OPUS: an efficient admissible algorithm for unordered search. J. Artif. Intell. Res., 1995, 3, 431-465.
48. Bergadano, F., Giordana, A., and Saitta, L. Automated concept acquisition in noisy environments. IEEE Trans. Pattern Anal. Mach. Learn., 1988, 10, 555-578.
49. Michalski, R. S. and Kaufman, K. A. A measure of description quality for data mining and its implementation in the AQ18 learning system. Proceedings of the International ICSC Congress on Computational intelligence methods and applications, Rochester, NY, USA, 1999, 369-375.
50. Schaffer, C. Overfilling avoidance as bias. Mach. Learn., 1993, 10, 153-178.
51. Fürnkranz, J. Pruning algorithms for rule learning. Mach. Learn., 1996, 27, 139-171.
52. Frank, E. Pruning decision trees and lists. PhD Thesis, Department of Computer Science, University of Waikato, Hamilton, New Zealand, 2000.
53. Pham, D. T. and Afify, A. A. A new MDL-based pruning technique for rule induction algorithms. Technical report, Manufacturing Engineering Centre, Cardiff University, 2004.
54. Quinlan, J. R. Learning logical definitions from relations. Mach. Learn., 1990, 5, 239-266.
55. Mitchell, T. M. Machine learning, 1997 (McGraw Hill, New York).
56. Blake, C. L. and Merz, C. J. UCI Repository of Machine Learning Databases. University of California, Department of Information and Computer Science, Irvine, CA, 1998, available from http://www.ics.uci.edu/~mlearn/ MLRepository.html, Accessed 1 February 2003.
57. Devijver, P. A. and Kittler, J. Pattern recognition: a statistical approach, 1982 (Prentice Hall, Englewood Cliffs, London).
58. Efron, B. and Tibshirani, R. An introduction to the bootstrap, 1993 (Chapman & Hall, USA).
59. Segal, R. B. Machine learning as massive search. PhD Thesis, Department of Computer Science and Engineering, University of Washington, 1997.
60. Aronis, J. and Provost, F. Increasing the efficiency of data mining algorithms with breadth-first marker propagation. Proceedings of the 3rd International Conference on Knowledge discovery and data mining, Newport Beach, CA, USA, 1997.
61. Graefe, G., Fayyad, U., and Chaudhuri, S. On the efficient gathering of sufficient statistics for classification of large SQL databases. Proceedings of the 4th International Conference on Knowledge discovery and data mining, 1998 (AAAI Press, New York, NY).