Integrating case-based learning and cognitive biases for machine learning of natural language

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 11, Issue 3, 1999, Pages 297-337

  Cardie, Claire ^a  

^a Department of Computer Science and School of Operations Research and Information Engineering   (United States)

Author keywords

Case based learning; Disambiguation; Feature weighting; Lexical tagging; Relative pronoun

Indexed keywords

EID: 22844456782     PISSN: 0952813X     EISSN: None     Source Type: Journal    
DOI: 10.1080/095281399146445     Document Type: Article

References (96)

1. Aha, D. W., 1992, Tolerating noisy irrelevant, and novel attributes in instance-based learning algorithms. International Journal of Man-machine Studies, 36: 267-287.
2. Aha, D. W., and Goldstone, R. L., 1992, Concept learning and flexible weighting. Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society, Indiana University, Bloomington, IN, USA (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 534-539.
3. Aha, D., Kibler, D., and Albert, M., 1991, Instance-based learning algorithms. Machine Learning, 6(1): 37-66.
4. Aone, C., and Bennett, W., 1995, Evaluating automated and manual acquisition of anaphora resolution strategies. Proceedings of the 33rd Annual Meeting of the ACL (Association for Computational Linguistics), pp. 122-129.
5. Argamon, S., Dagan, I., and Krymolowski, Y., 1998, A memory-based approach to learning shallow natural language patterns. Proceedings of the 36th Annual Meeting of the ACL and COLING-98 (Association for Computational Linguistics), pp. 67-73.
6. Atkeson, C. G., Moore, A. W., and Schaal, S., 1997, Locally weighted learning. Artificial Intelligence Review, 11: 11-73.
7. Azzam, S., Humphreys, K., and Gaizauskas, R., 1998, Evaluating a focus-based approach to anaphora resolution. Proceedings of the 36th Annual Meeting of the ACL and COLING-98 (Association for Computational Linguistics), pp. 74-78.
8. Bruce, R., and Wiebe, J., 1994, Word-sense disambiguation using decomposable models. Proceedings of the 32th Annual Meeting of the ACL, pp. 139-146.
9. Cain, T., Pazzani, M., and Silverstein, G., 1991, Using domain knowledge to influence similarity judgement. Proceedings of the Case-Based Reasoning Workshop (San Mateo, CA: Morgan Kaufmann), pp. 191-199.
10. Cardie, C., 1992, Using cognitive biases to guide feature set selection. Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society, Indiana University, Bloomington, IN, USA (Hillsdalu, NJ: Lawrence Erlbaum Associates), pp. 743-748.
11. Also in Working Notes of the 1992 AAAI Workshop on Constraining Learning with Prior Knowledge, San Jose, CA.
12. Cardie, C., 1993a, A case-based approach to knowledge acquisition for domain-specific sentence analysis. Proceedings of the Eleventh National Conference on Artificial Intelligence, Washington, DC, USA (Menlo Park, CA: AAAI Press; Cambridge, MA: MIT Press), pp. 798-803.
13. Cardie, C., 1993b, Using decision trees to improve case-based learning. Proceedings of the Tenth International Conference on Machine Learning, University of Massachusetts, Amherst, MA, USA (San Mateo, CA: Morgan Kaufmann), pp. 25-32.
14. Cardie, C., 1994, Domain-specific knowledge acquisition for conceptual sentence analysis. PhD thesis, University of Massachusetts, Amherst, MA, USA. Available as University of Massachusetts, CMPSCI Technical Report, 94-74.
15. Cardie, C., 1996, Embedded machine learning systems for natural language processing: A general framework. Symbolic, Connectionist, and Statistical Approaches to Learning for Natural Language Processing, Lecture Notes in Artificial Intelligence Series, edited by S. Wermter, E. Riloff and G. Scheler (Berlin: Springer), pp. 315-328.
16. Cardie, C., 1997, Empirical methods in information extraction. AI Magazine, 18(4): 65-79.
17. Cardie, C., 1999, A cognitive bias approach to feature set selection. Machine Learning, to appear.
18. Cardie, C., and Howe, N., 1997, Improving minority class prediction using case-specific feature weights. Proceedings of the Fourteenth International Conference on Machine Learning (San Francisco, CA: Morgan Kaufmann), pp. 57-65.
19. Cardie, C., and Lehnert, W., 1991, A cognitively plausible approach to understanding complicated syntax. Proceedings of the Ninth National Conference on Artificial Intelligence, Anaheim, CA, USA (Menlo Park, CA: AAAI Press; Cambridge, MA: MIT Press), pp. 117-124.
20. Cardie, C., and Wagstaff, K., 1999, Noun phrase coreference as clustering. Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC-99) (Association for Computational Linguistics), pp. 82-89.
21. Carreiras, M., Gernsbacher, M. A., and Villa, V., 1995, The advantage of first mention in Spanish. Psychonomic Bulletin and Review, 2: 124-129.
22. Caruana, R., and Freitag, D., 1994, Greedy attribute selection. Proceedings of the Eleventh International Conference on Machine Learning, Rutgers University, New Brunswick, NJ, USA (San Mateo, CA: Morgan Kaufmann), pp. 28-36.
23. Chinchor, N., Hirschman, L., and Lewis, D., 1993, Evaluating message understanding systems: an analysis of the third Message Understanding Conference (MUC-3). Computational Linguistics, 19(3): 409-449.
24. Clifton, C., Frazier, L., and Connine, C., 1984, Lexical expectations in sentence comprehension. Journal of Verbal Learning and Verbal Behavior, 23: 696-708.
25. Crain, S., and Steedman, M., 1985, On not being led up the garden path: The use of context by the psychological syntax processor. Natural Language Parsing: Psychological, Computational, and Theoretical Perspectives, edited by D. Dowty, L. Karttunen and A. Zwicky (Cambridge: Cambridge University Press), pp. 320-358.
26. Creecy, R., Masand, B., Smith, S., and Waltz, D., 1992, Trading mips and memory for knowledge engineering. Communications of the ACM, 35: 48-64.
27. Cuetos, F., and Mitchell, D. C., 1988, Cross-linguistic differences in parsing: restrictions on the use of the late closure strategy in Spanish. Cognition, 30(1): 73-105.
28. Daelemans, W., Durieux, G., and Gillis, S., 1994, The acquisition of stress: a data-oriented approach. Computational Linguistics, 20(3): 421-451.
29. Daelemans, W., van den Bosch, A., and Weijters, T., 1997, IGTree: using trees for compression and classification in lazy learning algorithms. Artificial Intelligence Review, 11: 407-423.
30. Daelemans, W., van den Bosch, A., and Zavrel, J., 1999, Forgetting exceptions is harmful in language learning. Machine Learning, 34(1-3): 11-43.
31. Daelemans, W., Zavrel, J., Berck, and Gillis, 1996, MBT: a memory-based part of speech tagger generator. Proceedings of the Fourth Workshop on Very Large Corpora (ACL SIGDAT), pp. 14-27.
32. Dagan, I., and Itai, A., 1991, A statistical filter for resolving pronoun references. Artificial Intelligence and Computer Vision, edited by Y. A. Feldman and A. Bruckstein (North Holland: Elsevier Science Publishers), pp. 125-135.
33. Daneman, M., and Carpenter, P. A., 1980, Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior, 19: 450-466.
34. Daneman, M., and Carpenter, P. A., 1983, Individual differences in integrating information between and within sentences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 9: 561-584.
35. Dietterich, T., 1998, Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10(7): 1895-1924.
36. Domingos, P., 1997, Context-sensitive feature selection for lazy learners. Artificial Intelligence Review, 11: 227-253.
37. Elman, J., 1990, Finding structure in time. Cognitive Science, 14: 179-211.
38. Fisher, D., 1987, Knowledge acquisition via incremental conceptual clustering. Machine Learning, 2: 139-172.
39. Fodor, J., 1989, Empty categories in sentence processing. Language and Cognitive Processes, 3/4: 155-209.
40. Frazier, L., 1979, On comprehending sentences: syntactic parsing strategies. Indiana University Linguistics Club, Bloomington, IN, USA.
41. Frazier, L., 1991, Parsing modifiers: special purpose routines in the human sentence processing mechanism? Comprehension Processes in Reading, edited by D. A. Balota, G. B. Flores d'Arcais and K. Rayner (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 303-330.
42. Frazier, L., and Fodor, J. D., 1978, The sausage machine: a new two-stage parsing model. Cognition, 6: 291-325.
43. Friedman, J. H., 1994, Flexible metric nearest neighbor classification. Unpublished manuscript available at playfair.stanford.edu via /pub/friedman/README.
44. Ge, N., Hale, J., and Charniak, E., 1998, A statistical approach to anaphora resolution. Proceedings of the Sixth Workshop on Very Large Corpora, Montreal, Canada (ACL SIGDAT), pp. 161-170.
45. Gernsbacher, M. A., and Hargreaves, D. J., 1988, Accessing sentence participants: the advantage of first mention. Journal of Memory and Language, 27: 199-717.
46. Gernsbacher, M. A., Hargreaves, D. J., and Beeman, M., 1989, Building and accessing clausal representations: the advantage of first mention versus the advantage of clause recency. Journal of Memory and Language, 28: 735-755.
47. Gibson, E., 1990, Recency preferences and garden-path effects. Proceedings of the Twelfth Annual Conference of the Cognitive Science Society, Massachusetts Institute of Technology, Cambridge, MA, USA (Hillsdale, NJ: Lawrence Erlbaum Associates).
48. Gibson, E., 1991, A computational theory of human linguistic processing: Memory limitations and processing breakdown. PhD thesis, Carnegie Mellon University, USA.
49. Gibson, E., and Pearlmutter, N., 1994, A corpus-based analysis of psycholinquistic constraints on prepositional-phrase attachment. Perspectives on Sentence Processing, edited by C. Clifton Jr, L. Frazier and K. Rayner (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 181-198.
50. Gibson, E., Pearlmutter, N., Canseco-Gonzalez, E., and Hickok, G., 1993, Cross-linguistic attachment preferences: evidence from English and Spanish. Sixth Annual CUNY Sentence Processing Conference, March 18-20, University of Massachusetts, Amherst, MA, USA.
51. Gordon, D., and desJardins, M., 1995, Evaluation and selection of biases in machine learning. Machine Learning, 20(1-2): 5-22.
52. Hastie, T. J., and Tibshirani, R. J., 1994, Discriminant adaptive nearest neighbor classification. Unpublished manuscript available at playfair.stanford.edu as /pub/hastie/dann.ps.Z.
53. Howe, N., and Cardie, C., 1997, Examining locally varying weights for nearest neighbor algorithms. Case-Based Reasoning Research and Development: Second International Conference on Case-Based Reasoning, Brown University, Providence, RI, USA, Lecture Notes in Artificial Intelligence, edited by D. Leake and E. Plaza (Berlin: Springer), pp. 455-466.
54. John, G., Kohavi, R., and Pfleger, K., 1994, Irrelevant features and the subset selection problem. Proceedings of the Eleventh International Conference on Machine Learning, Rutgers University, New Brunswick, NJ, USA (San Mateo, CA: Morgan Kaufmann), pp. 121-129.
55. Kehler, A., 1997, Probabilistic coreference in information extraction. Proceedings of the Second Conference on Empirical Methods in Natural Language Processing (Association for Computational Linguistics), pp. 163-173.
56. Kimball, J., 1973, Seven principles of surface structure parsing in natural language. Cognition, 2: 15-47.
57. King, J., and Just, M. A., 1991, Individual differences in syntactic processing: the role of working memory. Journal of Memory and Language, 30: 580-602.
58. Kolodner, J., 1993, Case-Based Reasoning (San Mateo, CA: Morgan Kaufmann).
59. Lappin, S., and Leass, H., 1994, An algorithm for pronominal anaphora resolution. Computational Linguistics, 20(4): 535-562.
60. Lehnert, W., 1990, Symbolic/subsymbolic sentence analysis: exploiting the best of two worlds. Advances in Connectionist and Neural Computation Theory, edited by J. Barnden and J. Pollack (Norwood, NJ: Ablex Publishers), pp. 135-164.
61. Lehnert, W., Cardie, C., Fisher, D., McCarthy, J., Riloff, E., and Soderlan, S., 1992, University of Massachusetts: description of the CIRCUS system as used in MUC-4. Proceedings of the Fourth Message Understanding Conference (MUC-4) (San Mateo, CA: Morgan Kaufmann), pp. 282-288.
62. Lehnert, W., Cardie, C., Fisher, D., Riloff, E., and Williams, R., 1991, University of Massachusetts: description of the CIRCUS system as used in MUC-3. Proceedings of the Third Message Understanding Conference (MUC-3) (San Mateo, CA: Morgan Kaufmann), pp. 223-233.
63. Lehnert, W., McCarthy, J., Soderland, S., Riloff, E., Cardie, C., Peterson, J., Feng, F., Dolan, C., and Goldman, S., 1993, University of Massachusetts/Hughes: description of the CIRCUS system as used in MUC-5. Proceedings of the Fifth Message Understanding Conference (MUC-5) (San Mateo, CA: Morgan Kaufmann), pp. 277-291.
64. Lehnert, W., and Sundheim, B., 1991, A performance evaluation of text analysis technologies. AI Magazine, 12(3): 81-94.
65. MacDonald, M. C., Pearlmutter, N. J., and Seidenberg, M. S., 1994, Syntactic ambiguity resolution as lexical ambiguity resolution. Perspectives on Sentence Processing, edited by C. Clifton Jr, L. Frazier and K. Rayner (Hillsdale, NJ: Lawrence Erlbaum Associates) (Menlo Park, CA: AAAI Press; Cambridge, MA: MIT Press), pp. 123-153.
66. McCarthy, J., and Lehnert, W., 1995, Using decision trees for coreference resolution. Proceedings of the Fourteenth International Conference on Artificial Intelligence, edited by C. Mellish, pp. 1050-1055.
67. Miller, G. A., 1956, The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63(1): 81-97.
68. Moore, A., and Lee, M., 1994, Efficient algorithms for minimizing cross validation error. Proceedings of the Eleventh International Conference on Machine Learning, Rutgers University, New Brunswick, NJ (San Mateo, CA: Morgan Kaufmann), pp. 190-198.
69. MUC-3, 1991, Proceedings of the Third Message Understanding Conference (MUC-3) (San Mateo, CA: Morgan Kaufmann).
70. MUC-4, 1992, Proceedings of the Fourth Message Understanding Conference (MUC-4) (San Mateo, CA: Morgan Kaufmann).
71. MUC-5, 1994, Proceedings of the Fifth Message Understanding Conference (MUC-5) (San Mateo, CA: Morgan Kaufmann).
72. MUC-6, 1995, Proceedings of the Sixth Message Understanding Conference (MUC-6) (San Francisco, CA: Morgan Kaufmann).
73. Newport, E., 1990, Maturational constraints on language learning. Cognitive Science, 14: 11-28.
74. Ng, H., and Lee, H., 1996, Integrating multiple knowledge sources to disambiguate word sense: an exemplar-based approach. Proceedings of the 34th Annual Meeting of the ACL (Association for Computational Linguistics), pp. 40-47.
75. Nicol, J., 1988, Coreference processing during sentence comprehension. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, USA.
76. Quinlan, J. R., 1983, Learning efficient classification procedures and their application to chess end games. Machine Learning: An Artificial Intelligence Approach, edited by R. S. Michalski, J. G. Carbonell and T. M. Mitchell (San Mateo, CA: Morgan Kaufmann).
77. Quinlan, J. R., 1992, C4.5: Programs for Machine Learning (San Mateo, CA: Morgan Kaufmann).
78. Riesbeck, C., and Schank, R., 1989, Inside Case-Based Reasoning (Northvale, NJ: Erlbaum).
79. Riloff, E., 1997, A corpus-based approach for building semantic lexicons. Proceedings of the Second Conference on Empirical Methods in Natural Language Processing (Association for Computational Linguistics), pp. 117-124.
80. Riloff, E., and Lehnert, W., 1994, Information extraction as a basis for high-precision text classification. ACM Transactions on Information Systems, 12(3): 296-333.
81. Roark, B., and Charniak, E., 1998, Noun-phrase co-occurrence statistics for semi-automatic semantic lexicon construction. Proceedings of the 36th Annual Meeting of the ACL and COLING-98 (Association for Computational Linguistics), pp. 1110-1116.
82. Schaffer, C., 1993, Overfilling avoidance as bias. Machine Learning, 10(2): 153-178.
83. Simmons, R., and Yu, Y., 1992, The acquisition and use of context-dependent grammars for English. Computational Linguistics, 18(4): 391-418.
84. Simpson, G., and Krueger, M., 1991, Selective access of homograph meanings in sentence context. Journal of Memory and Language, 30: 627-643.
85. Skalak, D., 1992, Representing cases as knowledge sources that apply local similarity metrics. Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society, Indiana University, Bloomington, IN, USA (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 325-330.
86. Skalak, D., 1994, Prototype and feature selection by sampling and random mutation hill climbing algorithms. Proceedings of the Eleventh International Conference on Machine Learning, Rutgers University, New Brunswick, NJ, USA (San Mateo, CA: Morgan Kaufmann), pp. 293-301.
87. Stanfill, C., and Waltz, D., 1986, Toward memory-based reasoning. Communications of the ACM, 29: 1213-1228.
88. Swinney, D. A., 1979, Lexical access during sentence comprehension: (re)consideration of context effects. Journal of Verbal Learning and Verbal Behavior, 18: 645-660.
89. Swinney, D., Ford, M., Bresnan, J., and Frauenfelder, U., 1988, Coreference assignment during sentence processing. Language Structure and Processing, edited by M. Macken (Palo Alto, CA: CSLI, Stanford).
90. Tanenhaus, M., Boland, J., Garnsey, S., and Carlson, G., 1989a, Lexical structure in parsing long-distance dependencies. Journal of Psycholinguistic Research, 18(1): 37-50.
91. Tanenhaus, M., Carlson, G., and Trueswell, J. C., 1989b, The role of thematic structures in interpretation and parsing. Language and Cognitive Processes, 4: 211-234.
92. Van den Bosch, A., and Daelemans, W., 1993, Data-oriented methods for grapheme-to-phoneme conversion. Proceedings of the Sixth Conference of the EACL, April 21-23, Utrecht, pp. 45-53. Also available as ITK Research Report 42.
93. Wettschereck, D., Aha, D. W., and Mohri, T., 1997, A review and empirical evaluation of feature-weighting methods for a class of lazy learning algorithms. Artificial Intelligence Review, 11: 273-314.
94. Xu, L., Yan, P., and Chang, T., 1989, Best first strategy for feature selection. Ninth International Conference on Pattern Recognition (Piscataway, NJ: IEEE Computer Society Press), pp. 706-708.
95. Yarowsky, D., 1992, Word-sense disambiguation using statistical models of Roget's categories trained on large corpora, August 23-28, Proceedings, COLING-92, pp. 454-460.
96. Zavrel, J., Daelemans, W., and Veenstra, J., 1997, Resolving pp attachment ambiguities with memory-based learning. Proceedings of the Workshop on Computational Language Learning (CoNLL '97) (Association for Computational Linguistics), pp. 136-144.