Dynamic Context Generation for Natural Language Understanding: A Multifaceted Knowledge Approach

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

Volumn 33, Issue 1, 2003, Pages 23-41

  Chan, Samuel W K ^a   Franklin, James ^b  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Connectionism; Context dependent model; Knowledge representation; Natural language understanding

Indexed keywords

ASSOCIATIVE STORAGE; CONTEXT SENSITIVE LANGUAGES; KNOWLEDGE REPRESENTATION; NEURAL NETWORKS; SEMANTICS; SYNTACTICS;

CONNECTIONISM;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 0142196589     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2003.811129     Document Type: Article

References (70)

1. S. Pinker, Language Learnability and Language Developments. Cambridge, MA: Harvard Univ. Press, 1984.
2. C. Cherry, On Human Communication. Cambridge, MA: MIT Press, 1975.
3. A. N. Chomsky, Syntactic Structures. Paris, France: Mouton, 1957.
4. M. A. Gernsbacher, Language Comprehension as Structure Building. Hillsdale, NJ: Lawrence Erlbaum, 1990.
5. M. A. K. Halliday and C. M. Matthiessen, Construing Experience Through Meaning. New York: Cassell, 1999.
6. J. Pustejovsky and B. Boguraev, "Lexical knowledge representation and natural language processing," Artif. Intell., vol. 63, no. 1-2, pp. 193-223, 1993.
7. P. A. Carpenter and M. Daneman, "Lexical retrieval and error recovery in reading: A model based on eye fixations," J. Verbal Learn. Verbal Behav., vol. 20, pp. 137-160, 1981.
8. W. Kintsch, "A cognitive architecture for comprehension," in Cognition: Conceptual and Methodological Issues, H. L. Pick, P. van den Broek, and D. C. Knill, Eds. Washington, DC: Psychol. Assoc., 1992, pp. 143-163.
9. C. R. Fletcher and C. P. Bloom, "Causal reasoning in the comprehension of simple narrative texts," J. Mem. Lang., vol. 27, pp. 235-244, 1988.
10. S. C. Shapiro, "SNePS: A logic for natural language understanding and commonsense reasoning," in Natural Language Processing and Knowledge Representation, L. M. Iwanska and S. C. Shapiro, Eds. Menlo Park, CA: AAAI, 2000, pp. 175-195.
11. J. R. Hobbs, M. E. Stickel, D. E. Appelt, and P. Martin, "Interpretation as abduction," Artif. Intell., vol. 63, pp. 69-142, 1993.
12. E. Charniak and R. Goldman, "A semantics for probabilistic quantifier-free first-order languages, with particular application to story understanding," in Proc. 11th Int. Joint Conf. Artificial Intelligence, vol. 2, 1989, pp. 1074-1079.
13. Y. Bar-Hillel, "Automatic translation of languages," in Advances in Computers, D. Booth and R. E. Meagher, Eds. New York: Academic, 1960, pp. 23-37.
14. G. W. Cottrell and S. L. Small, "A connectionist scheme for modeling word sense disambiguation," Cogn. Brain Theory, vol. 6, pp. 89-120, 1983.
15. D. L. Waltz and J. B. Pollack, "Massively parallel parsing: A strongly interactive model of natural language interpretation," Cogn. Sci., vol. 9, pp. 51-74, 1985.
16. T. E. Lange, "Lexical and pragmatic disambiguation and reinterpretation in connectionist networks," Int. J. Man-Mach. Stud., vol. 36, pp. 191-220, 1992.
17. M. F. St. John and J. L. McClelland, "Learning and applying contextual constraints in sentence comprehension," Artif. Intell., vol. 46, pp. 217-257, 1990.
18. N. Sharkey, Connectionist Natural Language Processing. Norwell, MA: Kluwer, 1992.
19. R. Miikkulainen, Subsymbolic Natural Language Processing; An Integrated Model of Scripts, Lexicon, and Memory. Cambridge, MA: MIT Press, 1993.
20. E. Brill, "Some advances in transformation-based part of speech tagging," in Proc. 12th Nat. Conf. Artificial Intelligence, 1994, vol. 1, pp. 722-727.
21. D. Yarowsky, "One sense per collocation," in Proc. ARPA Human Language Technology Workshops, NJ: Princeton, 1993, pp. 266-271.
22. B. Merialdo, "Tagging English text with a probabilistic model, " Comput. Linguist, vol. 20, no. 2, pp. 155-171, 1994.
23. L. M. Iwanska and S. C. Shapiro, Natural Language Processing and Knowledge Representation. Menlo Park, CA: AAAI, 2000.
24. C. Cardie, "Empirical methods in information extraction," AI Mag., vol. 18, no. 4, pp. 65-80, 1997.
25. R. Basili, M. T. Pazienza, and P. Velardi, "An empirical symbolic approach to natural language processing," Artif. Intell., vol. 85, pp. 59-99, 1996.
26. G. A. Miller, "WordNet - A lexical database for English," Commun. ACM, vol. 38, no. 11, pp. 39-41, 1995.
27. S. W. McRoy, "Using multiple knowledge sources for word sense discrimination," Comput. LinguisT., vol. 18, no. 1, pp. 1-30, 1992.
28. L. A. Urena, J. M. G. Hidalgo, and M. de-Buehaga, "Information retrieval by means of word sense disambiguation," in Lecture Notes in Artificial Intelligence. New York: Springer-Verlag, 2000, vol. 1902, pp. 93-98.
29. S. M. Harabagiu and D. I. Moldovan, "A parallel system for text inference using marker propagations," IEEE Trans. Parallel Distrib. Syst., vol. 9, pp. 729-747, Aug. 1998.
30. P. Resnik, "Using information content to evaluate semantic similarity in a taxonomy," in Proc. 14th Int. Joint Conf. Artificial Intelligence, vol. 1, 1995, pp. 448-452.
31. C. Leacock, G. Towell, and E. M. Voorhees, "Toward building contextual representations of word senses using statistical methods," in Corpus Processing for Lexical Acquisition, B. Boguraev and J. Pustejovsky, Eds. Cambridge, MA: MIT Press, 1996, pp. 97-113.
32. S. W. McRoy, "Achieving robust human-computer communication," J. Human-Comput. Studies, vol. 48, no. 5, pp. 681-704, 1998.
33. M. Redington, N. Chater, and S. Finch, "Distributional information: A powerful cue for acquiring syntactic categories," Cogn. Sci., vol. 22, no. 4, pp. 425-469, 1998.
34. G. Hirst, Semantic Interpretation and the Resolution of Ambiguity. Cambridge, U.K.: Cambridge Univ. Press, 1987.
35. W. Gale, K. Church, and D. Yarowsky, "One sense per discourse, " in Proc. DARPA Speech Natural Language Workshop, New York, 1992, pp. 233-237.
36. D. A. Cruse, Lexical Semantics. Cambridge, U.K.: Cambridge Univ. Press, 1986.
37. J. L. Elman, "Distributed representations, simple recurrent networks, and grammatical structure," Mach. Learn., vol. 7, pp. 195-225, 1991.
38. T. McArthur, Longman Lexicon of Contemporary English (English-Chinese Edition). White Plains, NY: Longman, 1992.
39. Chinese Knowledge Information Processing Group, Academia Sinica Balanced Corpus, Version 3.0. Taipei, Taiwan, R.O.C.: Inst. Inform. Sci., Academia Sinica, 1998.
40. G. Salton, A. Singhal, M. Mitra, and C. Buckley, "Automatic text structuring and summarization," Inf. Process. Manage., vol. 33, pp. 193-207, 1997.
41. G. E. Hinton, "Representing part-whole hierarchies in connectionist networks," Connectionist Res. Group, Univ. Toronto, Toronto, ON, Canada, Tech. Rep. CRC TR-882, 1988.
42. J. B. Pollack, "Recursive distributed representations," Artif. Intell., vol. 46, pp. 77-105, 1990.
43. P. Smolensky, "Tensor product variable binding and the representation of symbolic structures in connectionist systems," Artif. Intell., vol. 46, pp. 159-216, 1990.
44. P. Gupta and D. S. Touretzky, "Connectionist models and linguistic theory: Investigations of stress systems in language," Cogn. Sci., vol. 18, pp. 1-50, 1994.
45. A. Sperduti, "Stability properties of labeling recursive auto-associative memory," IEEE Trans. Neural Netw., vol. 6, pp. 1452-1460, Nov. 1995.
46. T. A. Plate, "Holographic reduced representations," IEEE Trans. Neural Networks, vol. 6, pp. 623-641, May 1995.
47. D. E. Rumelhart and J. L. McClelland, Parallel Distributed Processing. Cambridge, MA: MIT Press, 1986, vol. 1 and 2.
48. D. S. Blank, L. A. Meeden, and J. B. Marshall, "Exploring the symbolic/subsymbolic continuum: A case study of RAAM," in Closing the Gap: Symbolism vs. Connectionism, J. Dinsmore, Ed. New York: Lawrence Erlbaum, 1992.
49. M. G. Dyer, M. Flowers, and Y. J. A. Wang, "Distributed symbol discovery through symbol recirculation: Toward natural language processing in a distributed connectionist network," in Connectionist Approaches to Natural Language Processing, R. G. Reilly and N. E. Sharkey, Eds. New York: Lawrence Erlbaum, 1992, pp. 21-48.
50. Y. Wilks, D. Fass, C-M. Guo, J. McDonald, T. Plate, and B. Slator, "Providing machine tractable dictionary tools," in Semantics and the Lexicon, J. Pustejovsky, Ed. Norwell, MA: Kluwer, 1993, pp. 341-401.
51. J. A. Fodor and Z. W. Pylyshyn, "Connectionism and cognitive architecture: A critical analysis," in Connections and Symbols, S. Pinker and J. Mehler, Eds. Cambridge, MA: MIT Press, 1988, pp. 3-71.
52. C. J. Fillmore, "The case for case," in Universals in Linguistic Theory, E. Bach and R. T. Harms,' Eds. New York: Holt, Rinehart & Winston, 1968, pp. 1-90.
53. T. V. Geetha and R. K. Subramanian, "Representing natural language with Prolog," IEEE Softw., vol. 7, pp. 85-92, Mar. 1990.
54. R. F. Summons, "Semantic networks: Their computation and use for understanding English sentences," in Computer Models of Thought and Language, R. C. Schank and K. M. Colby, Eds. San Francisco, CA: Freeman, 1973, pp. 63-113.
55. J. Pearl, Probabilistic Inference in Intelligent Systems. San Mateo, CA: Morgan Kaufmann, 1988.
56. J. R. Anderson and C. Lebiere, The Atomic Components of Thought. Hillsdale, NJ: Lawrence Erlbaum, 1998.
57. S. Stoddard, Text and Texture: Patterns of Cohesion, Advances in Discourse Processes. Norwood, NJ: ABLEX, 1991, vol. XL.
58. S. Harnad, "The symbol grounding problem," Physica D, vol. 42, pp. 335-346, 1990.
59. M. Hoey, Patterns of Lexis in Text. Oxford, U.K.: Oxford Univ. Press, 1991.
60. H. Jackson, Words and Their Meaning. London, U.K.: Longman, 1988.
61. R. Sun, "An efficient feature-based connectionist inheritance scheme," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 1-12, Mar./Apr. 1993.
62. J. A. Hendler, "Marker-passing over microfeatures: Toward a hybrid symbolic/connectionist model," Cogn. Sci., vol. 13, pp. 79-106, 1989.
63. L. A. Bookman, Trajectories Through Knowledge Space: A Dynamic Framework for Machine Comprehension. Norwell, MA: Kluwer, 1994.
64. S. W. K. Chan and J. Franklin, "Symbolic connectionism in natural language disambiguation," IEEE Trans. Neural Networks, vol. 9, pp. 739-755, Sept. 1998.
65. S. W. K. Chan, "Integrating linguistic primitives in learning context-dependent representation," IEEE Trans. Knowledge Data Eng., vol. 13, pp. 157-175, Mar./Apr. 2001.
66. J. G. Carbonell and R. D. Brown, "Anaphora resolution: A multi-strategy approach," in Proc. Int. Conf. Computat. Linguist., 1988, pp. 96-101.
67. C. N. Li and S. A. Thompson, Mandarin Chinese: A Functional Reference Grammar. Los Angeles, CA: Univ. of California Press, 1981.
68. C.-R. Huang and K.-J. Chen, "Issues and topics in Chinese natural language processing," in Readings in Chinese Natural Language Processing, C.-R. Huang, K.-J. Chen, and B. K. T'sou, Eds., 1996, Monograph No. 9, pp. 1-22.
69. C. J. van Rijsbergen, Information Retrieval, Second ed. London, U.K.: Butterworths, 1979.
70. Y. Wilks and M. Stevenson, "Combining independent knowledge sources for word sense disambiguation," in Proc. Int. Conf. Recent Advances in Natural Language Processing, Tsigov Chark, Bulgaria, 1997, pp. 1-7.