A critical reassessment of evaluation baselines for speech summarization

ACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2008, Pages 470-478

  Penn, Gerald ^a   Zhu, Xiaodan ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC SPEECH RECOGNITION SYSTEM; DIFFERENT DOMAINS; EVALUATION STANDARD; LECTURE DATA; SPEECH SUMMARIZATION; STATE OF THE ART; SWITCHBOARD CORPUS;

COMPUTATIONAL LINGUISTICS;

SPEECH RECOGNITION;

EID: 84859883967     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. M. Ajmal, A. Kushki, and K. N. Plataniotis. 2007. Timecompression of speech in informational talks using spectral entropy. In Proceedings of the 8th InternationalWorkshop on Image Analysis for Multimedia Interactive Services (WIAMIS-07).
2. B Arons. 1992. Techniques, perception, and applications of time-compressed speech. In American Voice I/O Society Conference, pages 169-177.
3. B. Arons. 1994. Speech Skimmer: Interactively Skimming Recorded Speech. Ph.D. thesis, MIT Media Lab.
4. E. Brill. 1995. Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistics, 21(4):543-565.
5. F. Chen and M. Withgott. 1992. The use of emphasis to automatically summarize a spoken discourse. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), volume 1, pages 229-232.
6. E. Cherry and W. Taylor. 1954. Some further experiments on the recognition of speech, with one and two ears. Journal of the Acoustic Society of America, 26:554-559.
7. H. Christensen, B. Kolluru, Y. Gotoh, and S. Renals. 2004. From text summarisation to style-specific summarisation for broadcast news. In Proceedings of the 26th European Conference on Information Retrieval (ECIR-2004), pages 223-237.
8. M. Galley. 2006. A skip-chain conditional random field for ranking meeting utterances by importance. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP 2006).
9. L. He, E. Sanocki, A. Gupta, and J. Grudin. 1999. Auto summarization of audio-video presentations. In MULTIMEDIA'99: Proceedings of the seventh ACM international conference on Multimedia (Part 1), pages 489-498.
10. J. Hirschberg, S. Whittaker, D. Hindle, F. Pereira, and A. Singhal. 1999. Finding information in audio: A new paradigm for audio browsing and retrieval. In Proceedings of the ESCA/ETRW Workshop on Accessing Information in Spoken Audio, pages 117-122.
11. M. Kameyama and I. Arima. 1994. Coping with aboutness complexity in information extraction from spoken dialogues. In Proceedings of the 3rd International Conference on Spoken Language Processing (ICSLP), pages 87-90.
12. T. Kikuchi, S. Furui, and C. Hori. 2003. Two-stage automatic speech summarization by sentence extraction and compaction. In Proceedings of the ISCA/IEEE Workshop on Spontaneous Speech Processing and Recognition (SSPR), pages 207-210.
13. S. Maskey and J. Hirschberg. 2005. Comparing lexial, acoustic/prosodic, discourse and structural features for speech summarization. In Proceedings of the 9th European Conference on Speech Communication and Technology (Eurospeech), pages 621-624.
14. G. Murray, S. Renals, and J. Carletta. 2005. Extractive summarization of meeting recordings. In Proceedings of the 9th European Conference on Speech Communication and Technology (Eurospeech), pages 593-596.
15. G. Murray, S. Renals, J. Moore, and J. Carletta. 2006. Incorporating speaker and discourse features into speech summarization. In Proceedings of the Human Language Technology Conference - Annual Meeting of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL), pages 367-374.
16. National Institute of Standards. 1997-2000. Proceedings of the Text REtrieval Conferences. http://trec.nist.gov/pubs.html.
17. Abhishek Ranjan, Ravin Balakrishnan, and Mark Chignell. 2006. Searching in audio: the utility of transcripts, dichotic presentation, and time-compression. In CHI'06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 721-730, New York, NY, USA. ACM Press.
18. S. Tucker and S. Whittaker. 2006. Time is of the essence: an evaluation of temporal compression algorithms. In CHI'06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 329-338, New York, NY, USA. ACM Press.
19. R. Valenza, T. Robinson, M. Hickey, and R. Tucker. 1999. Summarization of spoken audio through information extraction. In Proceedings of the ESCA/ETRW Workshop on Accessing Information in Spoken Audio, pages 111-116.
20. K. Zechner and A. Waibel. 2000. Minimizing word error rate in textual summaries of spoken language. In Proceedings of the 6th Applied Natural Language Processing Conference and the 1st Meeting of the North American Chapter of the Association for Computational Linguistics (ANLP/NAACL), pages 186-193.
21. K. Zechner. 2001. Automatic Summarization of Spoken Dialogues in Unrestricted Domains. Ph.D. thesis, Carnegie Mellon University.
22. X. Zhu and G. Penn. 2005. Evaluation of sentence selection for speech summarization. In Proceedings of the RANLP workshop on Crossing Barriers in Text Summarization Research, pages 39-45.