Induction of word and phrase alignments for automatic document summarization

Computational Linguistics

Volumn 31, Issue 4, 2005, Pages 505-530

  Daumé III, Hal ^a,b   Marcu, Daniel ^a,b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; LINGUISTICS;

AUTOMATIC DOCUMENT SUMMARIZATION; AUTOMATIC SUMMARIZATION; BAG-OF-WORDS MODELS; HEADLINE GENERATION; LINGUISTIC DEVICES; SENTENCE EXTRACTION; SINGLE DOCUMENT SUMMARIZATION; TRAINING DATA;

ALIGNMENT;

EID: 33646428624     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/089120105775299140     Document Type: Article

References (47)

1. Aydin, Zafer, Yucel Altunbasak, and Mark Borodovsky. 2004. Protein secondary structure prediction with semi-Markov HMMs. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 17-21.
2. Banko, Michele, Vibhu Mittal, and Michael Witbrock. 2000. Headline generation based on statistical translation. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), pages 318-325, Hong Kong, October 1-8.
3. Barzilay, Regina and Noemie Elhadad. 2003. Sentence alignment for monolingual comparable corpora. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 25-32.
4. Baum, Leonard E. and J. E. Eagon. 1967. An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model of ecology. Bulletins of the American Mathematical Society, 73:360-363.
5. Baum, Leonard E. and Ted Petrie. 1966. Statistical inference for probabilistic functions of finite state Markov chains. Annals of Mathematical Statistics, 37:1554-1563.
6. Berger, Adam and Vibhu Mittal. 2000. Query-relevant summarization using FAQs. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), pages 294-301, Hong Kong, October 1-8.
7. Boyles, Russell A. 1983. On the convergence of the EM algorithm. Journal of the Royal Statistical Society, B(44):47-50.
8. Brown, Peter F., Stephen A. Della Pietra, Vincent J. Della Pietra, and Robert L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
9. Carletta, Jean. 1995. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2): 249-254.
10. Carroll, John, Guido Minnen, Yvonne Canning, Siobhan Devlin, and John Tait. 1998. Practical simplification of English newspaper text to assist aphasic readers. In Proceedings of the AAAI-98 Workshop on Integrating Artificial Intelligence and Assistive Technology.
11. Chandrasekar, Raman, Christy Doran, and Srinivas Bangalore. 1996. Motivations and methods for text simplification. In Proceedings of the International Conference on Computational Linguistics (COLING), pages 1041-1044, Copenhagen, Denmark.
12. Charniak, Eugene. 1997. Statistical parsing with a context-free grammar and word statistics. In Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI'97), pages 598-603, Providence, RI, July 27-31.
13. Daumé III, Hal and Daniel Marcu. 2002. A noisy-channel model for document compression. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), pages 449-456.
14. Daumé III, Hal and Daniel Marcu. 2004. A tree-position kernel for document compression. In Proceedings of the Fourth Document Understanding Conference (DUC 2004), Boston, MA, May 6-7.
15. Dempster, Arthur P., Nan M. Laird, and Donald B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B39(1):1-37.
16. Edmundson, H. P. 1969. New methods in automatic abstracting. Journal of the Association for Computing Machinery, 16(2):264-285.
17. Reprinted in Advances in Automatic Text Summarization, I. Mani and M. T. Maybury, (eds.).
18. Eisner, Jason. 2003. Learning non-isomorphic tree mappings for machine translation. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), Sapporo, Japan.
19. Ferguson, Jack D. 1980. Variable duration models for speech. In Proceedings of the Symposium on the Application of Hidden Markov Models to Text and Speech, pages 143-179, October, Princeton, NJ.
20. Gales, Mark J. F. and Steve J. Young. 1993. The theory of segmental hidden Markov models. Technical report, Cambridge University Engineering Department.
21. Gauvain, Jean-Luc and Chin-Hui Lee. 1994. Maximum a-posteriori estimation for multivariate Gaussian mixture observations of Markov chains. IEEE Transactions Speech and Audio Processing, 2:291-298.
22. Ge, Xianping and Padhraic Smyth. 2000. Segmental semi-Markov models for change-point detection with applications to semiconductor manufacturing. Technical report, University of California at Irvine, March.
23. Gildea, Daniel. 2003. Loosely tree-based alignment for machine translation. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), pages 80-87, Sapporo, Japan.
24. Grefenstette, Gregory. 1998. Producing intelligent telegraphic text reduction to provide an audio scanning service for the blind. In Working Notes of the AAAI Spring Symposium on Intelligent Text Summarization, pages 111-118, Stanford University, Stanford, CA.
25. Jensen, J. L. W. V. 1906. Sur les fonctions convexes et les inégalités entre les valeurs moyennes. Acta Mathematica, 30:175-193.
26. Jing, Hongyan. 2000. Sentence reduction for automatic text summarization. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), pages 310-315, Seattle, WA.
27. Jing, Hongyan. 2002. Using hidden Markov modeling to decompose human-written summaries. Computational Linguistics, 28(4)527-544.
28. Knight, Kevin and Daniel Marcu. 2002. Summarization beyond sentence extraction: A probabilistic approach to sentence compression. Artificial Intelligence, 139(1):91-107.
29. Kupiec, Julian, Jan O. Pedersen, and Francine Chen. 1995. A trainable document summarizer. In Proceedings of the Annual ACM Conference on Research and Development in Information Retrieval, pages 68-73.
30. Luhn, H. P. 1956. The automatic creation of literature abstracts. In I. Mani and M. Maybury, editors, Advances in Automatic Text Summarization. MIT Press, Cambridge, MA, pages 58-63.
31. Mahesh, Kavi. 1997. Hypertext summary extraction for fast document browsing. In Proceedings of the AAAI Spring Symposium on Natural Language Processing for the World Wide Web, pages 95-103, Stanford, CA.
32. Mani, Inderjeet. 2001. Automatic Summarization, volume 3 of Natural Language Processing. John Benjamins, Amsterdam/ Philadelphia.
33. Mani, Inderjeet and Mark Maybury, editors. 1999. Advances in Automatic Text Summarization. MIT Press, Cambridge, MA.
34. Marcu, Daniel. 1999. The automatic construction of large-scale corpora for summarization research. In Proceedings of the 22nd Conference on Research and Development in Information Retrieval (SIGIR-99), pages 137-144, Berkeley, CA, August 15-19.
35. Marcu, Daniel. 2000. The Theory and Practice of Discourse Parsing and Summarization. MIT Press, Cambridge, MA.
36. Mitchell, Carl D., Leah H. Jamieson, and Mary P. Harper. 1995. On the complexity of explicit duration HMMs. IEEE Transactions on Speech and Audio Processing, 3(3).
37. Och, Franz Josef and Hermann Ney. 2000. Improved statistical alignment models. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), pages 440-447, October, Hong Kong, China.
38. Och, Franz Josef and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19-51.
39. Ostendorf, Mari, Vassilis Digalakis, and Owen Kimball. 1996. From HMMs to segment models: A unified view of stochastic modeling for speech recognition. IEEE Transactions on Speech and Audio Processing, 4(5):360-378, September.
40. Quirk, Chris, Chris Brockett, and William Dolan. 2004. Monolingual machine translation for paraphrase generation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 142-149, Barcelona, Spain.
41. Schwartz, Richard, David Zajic, and Bonnie Dorr. 2002. Automatic headline generation for newspaper stories. In Proceedings of the Document Understanding Conference (DUC), pages 78-85, Philadelphia.
42. Smyth, Padhraic, David Heckerman, and Michael I. Jordan. 1997. Probabilistic independence networks for hidden Markov probability models. Neural Computation, 9(2):227-269.
43. Teufel, Simone and Mark Moens. 1997. Sentence extraction as a classification task. In In ACL/EACL-97 Workshop on Intelligent and Scalable Text Summarization, pages 58-65.
44. Vogel, Stephan, Hermann Ney, and Christoph Tillmann. 1996. HMM-based word alignment in statistical translation. In Proceedings of the International Conference on Computational Linguistics (COLING), pages 836-841.
45. Wu, Jeff C. F. 1983. On the convergence properties of the EM algorithm. The Annals of Statistics, 11:95-103.
46. Yamada, Kenji and Kevin Knight. 2001. A syntax-based statistical translation model. In Proceedings of the Conference of the Association for Computational Linguistics (ACL), pages 523-530.
47. Zajic, David, Bonnie Dorr, and Richard Schwartz. 2004. BBN/UMD at DUC-2004: Topiary. In Proceedings of the Fourth Document Understanding Conference (DUC 2004), pages 112-119, Boston, MA, May 6-7.