A comparison of Analogical Modeling to Memory-Based Language Processing

Human Cognitive Processing

Volumn 10, Issue , 2002, Pages 157-179

  Daelemans, Walter ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85190365457     PISSN: 13876724     EISSN: None     Source Type: Book Series    
DOI: 10.1075/hcp.10.13dae     Document Type: Chapter

References (42)

1. For our experiments we have used TiMBL, available from . It is a Memory-Based Learning software package developed in our group (Daelemans, Zavrel, van der Sloot, & van den Bosch 1998). TiMBL implements a number of important memory-based algorithms and metrics. We only describe those here which we used in the experiments below.
2. The specific analogical algorithm employed by Skousen is available in a number of implementations. See the AM group’s homepage at . For our experiments, we used an implementation by Gert Durieux, aml 0.1, available from .
3. This description of the algorithm is taken from Daelemans, Gillis, and Durieux 1997.
4. Available from
5. In these figures, the training set sizes on the x-axis are represented as categorical values, i.e., the 200 item training sets get as much space on the x-axis as the 2000 item datasets, hence the less steep learning curve, compared to Figure 1.
6. Aamodt, Agnar, & Enric Plaza (1994). Case-based reasoning: Foundational issues, methodological variations, and system approaches. AI Communications, 7, 39–59.
7. Aha, David W. (Ed.). (1997). Lazy learning. Dordrecht: Kluwer Academic Publishers.
8. Aha, David W., Dennis Kibler, & Marc K. Albert (1991). Instance-based learning algorithms. Machine Learning, 6, 37–66.
9. Atkeson, Chris, Andrew Moore, & Stefan Schaal (1997). Locally weighted learning. Artificial Intelligence Review, 11, 11–73.
10. Bybee, Joan (1988). Morphology as lexical organization. In M. Hammond & M. Noonan (Eds.), Theoretical morphology: Approaches in modern linguistics (pp. 119–141). San Diego: Academic Press.
11. Cardie, Claire (1996). Automatic feature set selection for case-based learning of linguistic knowledge. In Proceedings of conference on empirical methods in NLP. University of Pennsylvania.
12. Chandler, Steve (1992). Are rules and modules really necessary for explaining language? Journal of Psycholinguistic Research, 22, 593–606.
13. Clahsen, Harald (1999). Lexical entries and rules of language: A multidisciplinary study of German inflection. Behavioral and Brain Sciences, 22, 991–1060.
14. Cost, Scott, & Steven Salzberg (1993). A weighted nearest neighbour algorithm for learning with symbolic features. Machine Learning, 10, 57–78.
15. Cover, Thomas M., & Peter E. Hart (1967). Nearest neighbor pattern classification. Institute of Electrical and Electronics Engineers Transactions on Information Theory, 13, 21–27.
16. Daelemans, Walter (Ed.) (1999). Memory-based language processing, Volume 11, Number 3 (special issue) of Journal of Experimental and Theoretical AI. London: Taylor & Francis.
17. Daelemans, Walter, Steven Gillis, & Gert Durieux (1994). The acquisition of stress: a data-oriented approach. Computational Linguistics, 20, 421–451.
18. Daelemans, Walter, Steven Gillis, & Gert Durieux (1997). Skousen’s analogical modeling algorithm: A comparison with lazy learning. In D. Jones & H. Somers (Eds.), New methods in language processing (pp. 3–15). London: UCL Press.
19. Daelemans, Walter, & Antal van den Bosch (1992). Generalisation performance of backpropagation learning on a syllabification task. In M. F. J. Drossaers & A. Nijholt (Eds.), Proceedings of TWLT3: Connectionism and natural language processing (pp. 27–37). Enschede, The Netherlands: Twente University.
20. Daelemans, Walter, Antal van den Bosch, & A. J. M. M. Weijters (1997). igtree: using trees for compression and classification in lazy learning algorithms. Artificial Intelligence Review, 11, 407–423.
21. Daelemans, Walter, Antal van den Bosch, & Jakub Zavrel (1999). Forgetting exceptions is harmful in language learning. Machine Learning: Special issue on Natural Language Learning, 34, 11–41.
22. Daelemans, Walter, Jakub Zavrel, Ko van der Sloot, & Antal van den Bosch (1998). TiMBL: Tilburg Memory Based Learner, version 1.0, reference manual. Technical Report ILK-9803, ILK, Tilburg University.
23. Dasarathy, Belur V. (1991). Nearest neighbor (NN) norms: NN pattern classification techniques. Los Alamitos, CA: IEEE Computer Society Press.
24. Derwing, Bruce L., & Royal Skousen (1989). Real time morphology: Symbolic rules or analogical networks. Berkeley Linguistic Society, 15, 48–62.
25. Durieux, Gert, Walter Daelemans, & Steven Gillis (1997). Empirical comparison of analogical modeling and instance-based learning. Round table on algorithms for memory-based language processing. Corsendonk, Turnhout, Belgium.
26. Eddington, David (2000). Analogy and the dual-route model of morphology. Lingua, 110, 281–298.
27. Fix, Evelyn, & J. L. Hodges, Jr (1951). Disciminatory analysis – nonparametric discrimination; consistency properties. Technical Report Project 21-49-004, Report No. 4, USAF School of Aviation Medicine.
28. Gillis, Steven, Gert Durieux, & Walter Daelemans (2000). Lazy learning: A comparison of natural and machine learning of stress. In P. Broeder & J. Murre (Eds.), Models of language acquisition: Inductive and deductive approaches (pp. 76–99). Cambridge University Press.
29. Jones, Daniel (1996). Analogical natural language processing. London: UCL Press.
30. Kolodner, Janet L. (1993). Case-based reasoning. San Mateo, CA: Morgan Kaufmann.
31. Langacker, Ronald W. (1991). Concept, image, and symbol: The cognitive basis of grammar. Berlin: Mouton De Gruyter.
32. Marcus, Gary F., Ursula Brinkmann, Harald Clahsen, Richard Wiese, & Steven Pinker (1995). German inflection: The exception that proves the rule. Cognitive Psychology, 29, 189–256.
33. Nagao, Makoto (1984). A framework of a mechanical translation between Japanese and English by analogy principle. In A. Elithorn & R. Banerji (Eds.), Artificial and human intelligence (pp. 173–180). Amsterdam: North-Holland.
34. Nakisa, Ramin Charles, & Ulrike Hahn (1996). Where defaults don’t help: the case of the german plural system. In G. W. Cottrell (Ed.), Proceedings of the 18th annual conference of the cognitive science society (pp. 177–182).
35. Nakisa, Ramin Charles, Kim Plunkett, & Ulrike Hahn (2000). Single- and dual-route models of inflectional morphology. In P. Broeder & J. Murre (Eds.), Models of language acquisition: Inductive and deductive approaches (pp. 201–222). Cambridge University Press.
36. Quinlan, J. Ross (1993). C4.5: Programs for machine learning. San Mateo, CA: Morgan Kaufmann.
37. Riesbeck, Christoper K., & Roger S. Schank (1989). Inside case-based reasoning. Northvale, NJ: Erlbaum.
38. Scha, Remko, Rens Bod, & Khalil Sima’an (1999). A memory-based model of syntactic analysis: data-oriented parsing. Journal of Experimental and Theoretical Artificial Intelligence, 11, 409–440.
39. Skousen, Royal (1989). Analogical modeling of language. Dordrecht: Kluwer Academic Publishers.
40. Skousen, Royal (1992). Analogy and structure. Dordrecht: Kluwer Academic Publishers.
41. Stanfill, Craig, & David L. Waltz (1986). Toward memory-based reasoning. Communications of the acm, 29, 1213–1228.
42. Wulf, Douglas (1996). An analogical approach to plural formation in German. In Proceedings of the twelfth Northwest Linguistics Conference. Working papers in linguistics, Volume 14 (pp. 239–254).