Incremental learning with partial instance memory

Artificial Intelligence

Volumn 154, Issue 1-2, 2004, Pages 95-126

  Maloof, Marcus A ^a   Michalski, Ryszard S ^b,c  

^a GEORGETOWN UNIVERSITY   (United States)

^b George Mason University   (United States)

^c INSTITUTE OF COMPUTER SCIENCE   (Poland)

Author keywords

Concept drift; Incremental learning; On line concept learning; Partial instance memory

Indexed keywords

CONCEPT DRIFT; INCREMENTAL LEARNING; ONLINE CONCEPT LEARNING; PARTIAL INSTANCE MEMORY;

COMPUTER SOFTWARE; DATA STORAGE EQUIPMENT; LEARNING ALGORITHMS; LEARNING SYSTEMS; ONLINE SYSTEMS;

MULTI AGENT SYSTEMS;

EID: 1242310003     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2003.04.001     Document Type: Article

References (70)

1. Aha D., Kibler D., Albert M. Instance-based learning algorithms. Machine Learning. 6:1991;37-66.
2. Baim P. A method for attribute selection in inductive learning systems. IEEE Trans. Pattern Anal. Machine Intell. 10:(6):1988;888-896.
3. J. Becker, Topics in incremental learning of discriminant descriptions, Technical Report UIUCDCS-F-85-935, Department of Computer Science, University of Illinois, Urbana, IL, 1985.
4. Bhanu B., Fonder S. Learning based interactive image segmentation. Proceedings of the Fifteenth International Conference on Pattern Recognition (ICPR '00). 2000;299-302 IEEE Press, Los Alamitos, CA.
5. C. Blake, C. Merz, UCI repository of machine learning databases, http://www.ics.uci.edu/̃mlearn/mlrepository.html, Department of Information and Computer Sciences, University of California, Irvine, CA, 1998.
6. Bleha S., Slivinsky C., Hussien B. Computer-access security systems using keystroke dynamics. IEEE Trans. Pattern Anal. Machine Intell. 12:(12):1990;1217-1222.
7. E. Bloedorn, J. Wnek, R. Michalski, K. Kaufman, AQ17 - A multistrategy learning system: The method and user's guide, Reports of the Machine Learning and Inference Laboratory MLI 93-12, Machine Learning and Inference Laboratory, George Mason University, Fairfax, VA, 1993.
8. Boser B., Guyon I., Vapnik V. A training algorithm for optimal margin classifiers. Proceedings of the Fourth Workshop on Computational Learning Theory. 1992;144-152 ACM Press, New York.
9. Catania A. Learning. 4th Edition: 1998;Prentice-Hall, Upper Saddle River, NJ.
10. Cho K., Dunn S. Learning shape classes. IEEE Trans. Pattern Anal. Machine Intell. 16:1994;882-888.
11. Clark P., Niblett T. The CN2 induction algorithm. Machine Learning. 3:1989;261-284.
12. Cohen W. Fast effective rule induction. Proceedings of the Twelfth International Conference on Machine Learning. 1995;115-123 Morgan Kaufmann, San Francisco, CA.
13. J. Davis, CONVART: A program for constructive induction on time dependent data, Master's Thesis, Department of Computer Science, University of Illinois, Urbana, IL, 1981.
14. Denning D. An intrusion-detection model. IEEE Trans. Software Engrg. SE. 13:(2):1987;222-232.
15. Domingos P., Hulten G. Mining high-speed data streams. Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2000;71-80 ACM Press, New York.
16. Domingos P., Hulten G. A general method for scaling up machine learning algorithms and its application to clustering. Proceedings of the Eighteenth International Conference on Machine Learning. 2001;106-113 Morgan Kaufmann, San Francisco, CA.
17. Draper B., Bins J., Baek K. ADORE: Adaptive object recognition. Videre. 1:(4):2000;86-99. http://mitpress.mit.edu/e-journals/Videre/001/v14.html.
18. Elio R., Watanabe L. An incremental deductive strategy for controlling constructive induction in learning from examples. Machine Learning. 7:1991;7-44.
19. Fan W., Stolfo S., Zhang J. The application of AdaBoost for distributed, scalable and on-line learning. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1999;362-366 ACM Press, New York.
20. Fisher R. The use of multiple measurements in taxonomic problems. Annals of Eugenics. 7:1936;179-188.
21. Freund Y., Seung H., Shamir E., Tishby N. Selective sampling using the Query by Committee algorithm. Machine Learning. 28:1997;133-168.
22. Frisch A. Essential System Administration. 2nd Edition: 1995;O'Reilly & Associates, Sebastopol.
23. Hall J. Reconstructive and reproductive models of memory. Bull. Psychonomic Soc. 28:1990;191-194.
24. Hulten G., Spencer L., Domingos P. Mining time-changing data streams. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2001;97-106 ACM Press, New York.
25. Iba W., Woogulis J., Langley P. Trading simplicity and coverage in incremental concept learning. Proceedings of the Fifth International Conference on Machine Learning. 1988;73-79 Morgan Kaufmann, San Francisco, CA.
26. Jain A., Murty M., Flynn P. Data clustering: A review. ACM Comput. Surv. 31:(3):1999;264-323.
27. Keppel G., Saufley W., Tokunaga H. Introduction to Design and Analysis. 2nd Edition: 1992;W.H. Freeman, New York.
28. Kerber R. ChiMerge: Discretization of numeric attributes. Proceedings of AAAI-92, San Jose, CA. 1992;123-128 AAAI Press, Menlo Park, CA.
29. Kibler D., Aha D. Learning representative exemplars of concepts: An initial case study. Proceedings of the Fourth International Conference on Machine Learning. 1987;24-30 Morgan Kaufmann, San Francisco, CA.
30. Kubat M., Krizakova I. Forgetting and aging of knowledge in concept formation. Appl. Artificial Intelligence. 6:1992;195-206.
31. Lane T., Brodley C. Temporal sequence learning and data reduction for anomaly detection. ACM Trans. Inform. System Security. 2:(3):1999;295-331.
32. Lee W., Stolfo S., Mok K. Adaptive intrusion detection: A data mining approach. Artificial Intelligence Rev. 14:(6):2000;533-567.
33. Lindenbaum M., Markovich S., Rusakov D. Selective sampling for nearest neighbor classifiers. Proceedings of AAAI-99, Orland, FL. 1999;366-371 AAAI Press, Menlo Park, CA.
34. Lippmann R., Haines J., Fried D., Korba J., Das K. The 1999 DARPA off-line intrusion detection evaluation. Computer Networks. 34:2000;579-595.
35. Little J., Boyd J. Recognizing people by their gate: The shape of motion. Videre. 1:(2):1998;1-32. http://mitpress.mit.edu/e-journals/Videre/001/v12.html.
36. Littlestone N. Redundant noisy attributes, attribute errors, and linear-threshold learning using Winnow. Proceedings of the Fourth Annual Workshop on Computational Learning Theory. 1991;147-156 Morgan Kaufmann, San Francisco, CA.
37. Littlestone N., Warmuth M. The Weighted Majority algorithm. Inform. and Comput. 108:1994;212-261.
38. M. Maloof, Progressive partial memory learning, PhD Thesis, School of Information Technology and Engineering, George Mason University, Fairfax, VA, 1996.
39. Maloof M. An initial study of an adaptive hierarchical vision system. Proceedings of the Seventeenth International Conference on Machine Learning. 2000;567-573 Morgan Kaufmann, San Francisco, CA.
40. Maloof M., Duric Z., Michalski R., Rosenfeld A. Recognizing blasting caps in X-ray images. Proceedings of the Image Understanding Workshop. 1996;1257-1261 Morgan Kaufmann, San Francisco, CA.
41. Maloof M., Langley P., Binford T., Nevatia R. Generalizing over aspect and location for rooftop detection. Proceedings of the Fourth IEEE Workshop on Applications of Computer Vision (WACV '98). 1998;194-199 IEEE Press, Los Alamitos, CA.
42. Maloof M., Michalski R. A method for partial-memory incremental learning and its application to computer intrusion detection. Proceedings of the Seventh IEEE International Conference on Tools with Artificial Intelligence. 1995;392-397 IEEE Press, Los Alamitos, CA.
43. Maloof M., Michalski R. Learning symbolic descriptions of shape for object recognition in X-ray images. Expert Systems Appl. 12:(1):1997;11-20.
44. Maloof M., Michalski R. Selecting examples for partial memory learning. Machine Learning. 41:2000;27-52.
45. Maloof M., Michalski R. Incremental learning with partial instance memory. Foundations of Intelligent Systems. Lecture Notes in Artificial Intelligence. vol. 2366:2002;16-27 Springer, Berlin.
46. Meir R., El-Yaniv R., Ben-David S. Localized boosting. Proceedings of the Thirteenth Annual Conference on Computational Learning Theory. 2000;190-199 Morgan Kaufmann, San Francisco, CA.
47. R. Michalski, K. Kaufman, The AQ-19 system for machine learning and pattern discovery: A general description and user's guide, Reports of the Machine Learning and Inference Laboratory MLI 01-4, Machine Learning and Inference Laboratory, George Mason University, Fairfax, VA, 2001.
48. 1 hypotheses: The underlying methodology and the description of program AQ11, Technical Report UIUCDCS-F-83-905, Department of Computer Science, University of Illinois, Urbana, 1983.
49. Michalski R. On the quasi-minimal solution of the general covering problem. Proceedings of the Fifth International Symposium on Information Processing, vol. A3. 1969;125-128.
50. Michalski R. AQVAL/1 - Computer implementation of a variable-valued logic system and its application to pattern recognition. Proceedings of IJCAI-69, Washington, DC. 1969;3-17.
51. Michalski R. Pattern recognition as rule-guided inductive inference. IEEE Trans. Pattern Anal. Machine Intell. 2:(4):1980;349-361.
52. Michalski R. A theory and methodology of inductive learning. Michalski R., Carbonell J., Mitchell T. Machine Learning: An Artificial Intelligence Approach, vol. 1. 1983;83-134 Morgan Kaufmann, San Francisco, CA.
53. Muslea I., Minton S., Knoblock C. Selective sampling with redundant views. Proceedings of AAAI-2000, Austin, TX. 2000;621-626 AAAI Press, Menlo Park, CA.
54. Pope A., Lowe D. Probabilistic models of appearance for 3-D object recognition. Intern. J. Comput. Vision. 40:(2):2000;149-167.
55. Quinlan J. C4.5: Programs for Machine Learning. 1993;Morgan Kaufmann, San Francisco, CA.
56. Reinke R., Michalski R. Incremental learning of concept descriptions: A method and experimental results. Hayes J., Michie D., Richards J. Machine Intelligence. vol. 11:1988;263-288 Clarendon Press, Oxford.
57. Rosenberg C. Image color constancy using EM and cached statistics. Proceedings of the Seventeenth International Conference on Machine Learning. 2000;799-806 Morgan Kaufmann, San Francisco, CA.
58. Salganicoff M. Density-adaptive learning and forgetting. Proceedings of the Tenth International Conference on Machine Learning. 1993;276-283 Morgan Kaufmann, San Francisco, CA.
59. Sarkar S., Soundararajan P. Supervised learning of large perceptual organization: Graph spectral partitioning and learning automata. IEEE Trans. Pattern Anal. Machine Intell. 22:(5):2000;504-525.
60. Schapire R. A brief introduction to boosting. Proceedings of IJCAI-99, Stockholm, Sweden. 1999;Morgan Kaufmann, San Francisco, CA.
61. Schlimmer J., Granger R. Beyond incremental processing: Tracking concept drift. Proceedings of AAAI-86, Philadelphia, PA. 1986;502-507 AAAI Press, Menlo Park, CA.
62. Somlo G., Howe A. Incremental clustering for profile maintenance in information gathering web agents. Proceedings of the Fifth International Conference on Autonomous Agents. 2001;262-269 ACM Press, New York.
63. Syed N., Liu H., Sung K. Handling concept drifts in incremental learning with support vector machines. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1999;272-276 ACM Press, New York.
64. S. Thrun, J. Bala, E. Bloedorn, I. Bratko, B. Cestnik, J. Cheng, K. DeJong, S. Dzeroski, S. Fahlman, D. Fisher, R. Hamann, K. Kaufman, S. Keller, I. Kononenko, J. Kreuziger, R. Michalski, T. Mitchell, P. Pachowicz, Y. Reich, H. Vafaie, W. van de Welde, W. Wenzel, J. Wnek, J. Zhang, The MONK's problems: A performance comparison of different learning algorithms, Technical Report CMU-CS-91-197, School of Computer Science, Carnegie Mellon University, Pittsburg, PA, 1991.
65. Utgoff P., Berkman N., Clouse J. Decision tree induction based on efficient tree restructuring. Machine Learning. 29:1997;5-44.
66. Walpole R., Myers R., Myers S. Probability and Statistics for Engineers and Scientists. 6th Edition: 1998;Prentice-Hall, Upper Saddle River, NJ.
67. Widmer G. Tracking context changes through meta-learning. Machine Learning. 27:1997;259-286.
68. Widmer G., Kubat M. Learning in the presence of concept drift and hidden contexts. Machine Learning. 23:1996;69-101.
69. Winston P. Learning structural descriptions from examples. Winston P. Psychology of Computer Vision. 1975;MIT Press, Cambridge, MA.
70. Yoo J., Pettey C., Yoo S. A hybrid conceptual clustering system. Proceedings of the Twenty-fourth Annual Conference on Computer Science. 1996;105-114 ACM Press, New York.