Extraction of salient textual patterns: Synergy between lexical cohesion and contextual coherence

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

Volumn 34, Issue 2, 2004, Pages 205-218

  Chan, Samuel W K ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Connectionist model; Knowledge extraction; Salient textual pattern discovery; Semantic relatedness

Indexed keywords

FEATURE EXTRACTION; KNOWLEDGE BASED SYSTEMS; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS; TEXT PROCESSING;

CONTEXTUAL COHERENCE; LEXICAL COHESION; SALIENT TEXTUAL PATTERNS; SYNERGY;

INFORMATION RETRIEVAL SYSTEMS;

EID: 1542395667     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2003.820570     Document Type: Article

References (79)

1. J. F. Allen, R. Fikes, and E. Sandewall, "Principles of knowledge representation and reasoning," in Proc. 2nd Int. Conf., San Mateo, CA, 1991.
2. R. Alterman, "A dictionary based on concept coherence," Artif. Intell., vol. 25, pp. 153-186, 1985.
3. R. Alterman and L. A. Bookman, "Reasoning about a semantic memory encoding of the connectivity of events," Cogn. Sci., 16, pp. 205-232, 1992.
4. J. A. Anderson and G. L. Murphy, "Psychological concepts in a parallel system," Phys. D, vol. 22, pp. 318-336, 1986.
5. J. A. Anderson, J. W. Silverstein, S. A. Ritz, and R. S. Jones, "Distinctive features, categorical perception, and probability learning: Some applications of a neural model," Psychol. Rev., vol. 84, no. 5, pp. 413-451, 1977.
6. V. Bansal and R. M. K. Sinha, "Integrating knowledge sources in devanagari text recognition system," IEEE Trans. Syst., Man, Cybern. A, vol. 30, pp. 500-505, July 2000.
7. R. Basili, M. T. Pazienza, and P. Velardi, "An empirical symbolic approach to natural language processing," Artif. Intell., vol. 85, pp. 59-99, 1996.
8. M. Benson, "Collocations and general-purpose dictionaries," Int. J. Lexicography, vol. 2, pp. 1-14, 1990.
9. G. D. Blank, "A finite and real-time processor for natural language," Commun. ACM, vol. 32, no. 10, pp. 1174-1189, 1989.
10. C. J. Brainerd and V. F. Reyna, "Gist is the grist: Fuzzy-trace theory and the new intuitionism," Develop. Rev., vol. 10, pp. 3-47, 1990.
11. J. Carletta, "Assessing agreement on classification tasks: The kappa statistic," Comput. Ling., vol. 22, no. 2, pp. 249-254, 1996.
12. S. W. K. Chan, "Integrating linguistic primitives in learning context-dependent representation," IEEE Trans. Knowl. Data Eng., vol. 13, pp. 157-175, Mar./Apr. 2001.
13. S. W. K. Chan and J. Franklin, "Dynamic context generation for natural language understanding: A multifaceted knowledge approach," IEEE Trans. Syst., Man, Cybern. A, vol. 33, pp. 23-41, Jan. 2003.
14. T. C. Craven, "Graphic display of larger sentence dependency structures," J. Amer. Soc. Inform. Sci., vol. 42, no. 5, pp. 323-31, 1991.
15. M. G. Dyer, In-Depth Understanding: A Computer Model of Integrated Processing for Narrative Comprehension. Cambridge, MA: MIT Press, 1983.
16. M.-F. Ehrlich and M. Charolles, "Aspects of textual continuity: Psycholinguistic approaches," in Text & Text Processing, G. Denhiere and J.-P. Rossi, Eds. Amsterdam, The Netherlands: North-Holland, 1991, pp. 269-285.
17. H. C. Ellis and R. R. Hunt, Fundamentals of Human Memory and Cognition. New York: Wise, 1989.
18. B. Endres-Niggemeyer and E. Neugebauer, "Professional summarizing: No cognitive simulation without observation," J. Amer. Soc. Inform. Sci., vol. 49, no. 6, pp. 486-506, 1998.
19. C. R. Fletcher, J. E. Hummel, and C. J. Marsolek, "Causality and the allocation of attention during comprehension," J. Exper. Psychol., vol. 16, no. 2, pp. 233-240, 1990.
20. W. Gale, K. Church, and D. Yarowsky, "Estimated upper and lower bounds on the performance of word-sense disambiguation programs," in Proc. 30th Annu. Meeting Association Computational Linguistics, 1992, pp. 249-256.
21. R.M. Golden, D. E. Rumelhart, J. Strickland, and A. Ting, "Markov random fields for text comprehension," in Neural Networks for Knowledge Representation and Inference, D. S. Levine and M. Aparicio IV, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1994, pp. 283-309.
22. S. J. Green, "Building hypertext links by computing semantic similarity," IEEE Trans. Know. Data Eng., vol. 11, pp. 713-730, Sept./Oct. 1999.
23. J. E. Grimes, The Thread of Discourse. The Hague, The Netherlands: Mouton, 1975.
24. B. J. Grosz and C. L. Sidner, "Attention, intention, and the structure of discourse," Comput. Linguistics, vol. 12, pp. 175-204, 1986.
25. B. J. Grosz, A. K. Joshi, and S. Weinstein, "Centering: A framework for modeling the local coherence of discourse," Comput. Linguisti., vol. 21, pp. 203-225, 1995.
26. U. Hahn, "Topic parsing: Accounting for text marco structures in full-text analysis," Inform. Process. Manage., vol. 26, pp. 135-170, 1990.
27. M. A. K. Halliday and R. Hasan, Cohesion in English. London, U.K.: Longman, 1976.
28. ____, Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective. Victoria, Auatralia: Deakin Univ. Press, 1985.
29. S. M. Harabagiu and D. I. Moldovan, "Enriching the wordnet taxonomy with contextual knowledge acquired from text," in Natural Language Processing and Knowledge Representation: Language for Knowledge and Knowledge for Language, L. M. Iwanska and S. C. Shapiro, Eds. Cambridge, MA: MIT Press, 2000, pp. 301-333.
30. M. Hearst, "TextTiling: Segmenting text into multi-paragraph subtopic passages," Comput. Linguistics, vol. 23, no. 1, pp. 33-64, 1997.
31. J. R. Hobbs, "Coherence and coreference," Cogn. Sci., vol. 3, no. 1, pp. 26-48, 1979.
32. J. R. Hobbs, M. E. Stickel, D. E. Appelt, and P. Martin, "Interpretation as abduction," Artif. Intell., vol. 63, pp. 69-142, 1993.
33. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," Proc. Nat. Acad. Sci., vol. 79, pp. 1554-1558, 1982.
34. E. H. Hovy, "Automated discourse generation using discourse structure relations," Artif. Intell., vol. 63, pp. 341-385, 1993.
35. A. Isard and J. Carletta, "Replicability of transaction and action coding in the map task corpus," in Empirical Methods in Discourse: Interpretation and Generation, J. Moore and M. Walker, Eds. Menlo Park, CA: AAAI, 1995.
36. L. Iwanska, "Recovering nonlinearly distributed knowledge: Computing discourse structure in factual reports," Natural Lang. Eng., vol. 3, pp. 191-123, 1997.
37. P. S. Jacobs and L. F. Rau, "Innovations in text interpretation," Artif. Intell., vol. 63, pp. 143-191, 1993.
38. P. N. Johnson-Laird, "How is meaning mentally represented?," in Meaning and Mental Representation, U. Eco, M. Santambrogio, and P. Violi, Eds. Bloomington, IN: Univ. of Indiana Press, 1988, pp. 99-118.
39. H. Kamp and U. Reyle, From Discourse to Logic: Introduction to Model Theoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory. Norwell, MA: Kluwer, 1993.
40. W. Kintsch, "A cognitive architecture for comprehension," in Cognition: Conceptual and Methodological Issues, H. L. Pick, P. van den Broek, and D. C. Knill, Eds. Washington, DC: Amer. Psychol. Assoc., 1992, pp. 143-163.
41. W. Kintsch and T. A. van Dijk, "Toward a model of text comprehension and production," Psychol. Rev., vol. 85, no. 5, pp. 363-394, 1978.
42. B. Kosko, "Fuzzy cognitive maps," Int. J. Man-Mach. Stud., vol. 24, pp. 65-75, 1986.
43. K. Krippendorff, Content Analysis: An Introduction to its Methodology. Newbury Park, CA: Sage, 1980.
44. D. Kurzon, "Signposts for the reader: A corpus-based study of text," Text, vol. 5, pp. 187-200, 1985.
45. W. Lam and K. S. Ho, "FIDS: An intelligent financial web news articles digest system," IEEE Trans. Syst., Man, Cybern. A, vol. 31, pp. 753-762, Nov. 2001.
46. S. Lappin and H. J. Leases, "An algorithm for pronominal anaphora resolution," Comput. Linguist., vol. 20, no. 4, pp. 535-561, 1994.
47. M. Lebowitz, "The use of memory in text processing," Commun. ACM, vol. 31, no. 12, pp. 1483-1502, 1988.
48. W. E. Lilo, D. C. Miller, S. Hui, and S. H. Zak, "Synthesis of brain-state-in-a-box (BSB) based associative memories," IEEE Trans. Neural Networks, vol. 5, pp. 730-737, Sept. 1994.
49. D. J. Litman and R. J. Passonneau, "Combining multiple knowledge sources for discourse segmentation," in Proc. 33rd Annu. Meeting Association Computational Linguistics, 1995, pp. 108-115.
50. J. M, Mandler and N. S. Johnson, "Remembrance of things parsed: Story structure and recall," Cogn. Psychol., vol. 9, pp. 111-151, 1977.
51. W. C. Mann and S. A. Thompson, "Rhetorical structure theory: Toward a functional theory of text organization," Text, vol. 8, no. 3, pp. 243-281, 1981.
52. D. Marcu, "Discourse trees are good indicators of importance in text," in Advances in Automatic Text Summarization, I. Mani and M. Maybury, Eds. Cambridge, MA: MIT Press, 1999, pp. 123-136.
53. K. R. McKeown, Text Generation: Using Discourse Strategies and Focus Constraints to Generate Natural Language Text. Cambridge, U.K.: Cambridge Univ. Press, 1985.
54. G. McKoon and R. Ratcliff, "Inference during reading," Psychol. Rev., vol. 99, no. 3, pp. 440-466, 1992.
55. R. Miikkulainen, Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and Memory. Cambridge, MA: MIT Press, 1993.
56. R. Mitkov, "Robust pronoun resolution with limited knowledge," in Proc. Int. Conf. Computational Linguistics, 1998, pp. 869-875.
57. M.-F. Moens, C. Uyttendaele, J. Dumortier, "Abstracting of legal cases: The potential of clustering based on the selection of representative objects," J. Amer. Soc. Inf. Sci., vol. 50, no. 2, pp. 151-161, 1999.
58. J. Moore and C. Paris, "Planning text for advisory dialogues: Capturing international and rhetorical information," Comput. Linguist., vol. 19, pp. 651-694, 1993.
59. J. Morris and G. Hirst, "Lexical cohesion computed by thesaural relations as an indicator of the structure of text," Comput. Linguist., vol. 17, no. 1. pp. 21-48, 1991.
60. T. Nomoto and Y. Nitta, "Structuring raw discourse," in New Methods in Language Processing, D. Jones and H. Somers, Eds. London, U.K.: UCL Press, 1997, pp. 288-298.
61. C. Paice, "Constructing literature abstracts by computer: Techniques and prospects," Inform. Process. Manage., vol. 26, pp. 171-186, 1990.
62. R. Passonneau and D. Litman, "Intention-based segmentation: Human reliability and correlation with linguistic cues," in Proc. 31st Annu. Meeting Association Computational Linguistics, 1993, pp. 148-155.
63. L. Polanyi, "A formal model of the structure of discourse," J. Pragmatics, vol. 12, no. 5-6, pp. 601-638, 1988.
64. R. Quirk, S. Greenbaum, and G. Leech, A Comprehensive Grammar of the English Language. London, U.K.: Longman, 1985.
65. D. V. Rama and P. Srinivasan, "An investigation of content representation using text grammars," ACM Trans. Inform. Syst., vol. 11, pp. 51-75, 1993.
66. D. E. Rumelhart, "Notes on a schema for stories," in Representation and Understanding: Studies in Cognitive Science, D. G. Bobrow and A. Collins, Eds. Orlando, FL: Academic, 1975, pp. 211-236.
67. G. Salton, A. Singhal, M. Mitra and C. Buckley, "Automatic text structuring and summarization," Inf. Process. Manage., vol. 33, pp. 193-207, 1997.
68. A. Schultz, "Collective recall via the brain-state-in-a-box network," IEEE Trans. Neural Networks, vol. 4, pp. 580-587, July 1993.
69. Y. Shen, "Parsing procedures for stories," in Co-operating With Written Texts, D. Stein, Ed. Berlin, Germany: Mouton de Gruyter, 1992, pp. 609-629.
70. S. Siegel and N. J. Castellan, Nonparametric Statistics for the Behavioral Sciences, 2 ed. New York: McGraw-Hill, 1988.
71. P. Smolensky, "Connectionist modeling: Neural computational/mental connections," in Neural Connections, Mental Computation, L. Nadel, L. A. Cooper, P. Culicover, and R. M. Harnish, Eds. Cambridge, MA: MIT Press, 1989, pp. 49-67.
72. N. L. Stein and C. G. Glenn, "An analysis of story comprehension in elementary school children," in New Directions in Discourse Processing, R. O. Freedle, Ed. Norwood, NJ: Ablex, 1979, pp. 53-120.
73. S. Stoddard, "Text and Texture: Patterns of Cohesion," in Advances in Discourse Processes. Norwood, NJ: Ablex, 1991, vol. 40.
74. T. Tombros and F. Crestani, "Users' perception of relevance of spoken documents," J. Amer. Soc. Inf. Sci., vol. 51, no. 10, pp. 929-39, 2000.
75. T. Trabasso and L. L. Sperry, "Causal cohesion and story coherence," in Learning and Comprehension of Text, H. Mandl, N. L. Stein, and T. Trabasso, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1984, pp. 83-111.
76. D. L. Waltz and J. B. Pollack, "Massively parallel parsing: A strongly interactive model of natural language interpretation," Cogn. Sci., vol. 9, pp. 51-74, 1985.
77. J. Wiebe, G. Hirst, and D. Horton, "Language use in context," Commun. ACM, vol. 39, pp. 102-111, 1996.
78. T. Winograd, Understanding Natural Language. New York, Academic, 1972.
79. R. A. Zwaan, J. P. Magliano, and A. C. Graesser, "Dimensions of situation model construction in narrative comprehension," J. Exper. Psychol., vol. 21, no. 2, pp. 386-397, 1995.