Comparing evaluation metrics for sentence boundary detection

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 4, Issue , 2007, Pages 185-188

  Liu, Yang ^a   Shriberg, Elizabeth ^b,c  

^a The University of Texas at Dallas   (United States)

^b SRI INTERNATIONAL   (United States)

^c INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

Precision; Recall; ROC curve; Sentence boundary detection

Indexed keywords

CLASSIFICATION (OF INFORMATION); ERROR DETECTION; PRECISION ENGINEERING; REAL TIME SYSTEMS; SPEECH RECOGNITION;

ERROR RATES; LANGUAGE PROCESSING; SENTENCE BOUNDARY DETECTION; WORD STREAMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 34547539128     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2007.367194     Document Type: Conference Paper

References (12)

1. D. Jones, F. Wolf, E. Gibson, E. Williams, E. Fedorenko, D. Reynolds, and M. Zissman, "Measuring the readability of automatic speech-to-text transcripts," in Proc. of Eurospeech, 2003, pp. 1585-1588.
2. M. Harper, B. Dorr, B. Roark, J. Hale, Z. Shafran, Y. Liu, M. Lease, M. Snover, L. Young, R. Stewart, and Ë. Krasnyanskaya, "Final report: parsing speech and structural event detection," http://www.clsp.jhu.edu/ ws2005/groups/eventdetect/documents/final report.pdf, 2005.
3. Y. Liu, E. Shriberg, A. Stolcke, D. Hillard, M. Ostendorf, and M. Harper, "Enriching speech recognition with automatic detection of sentence boundaries and disfluencies," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14(5), pp. 1526-1540, 2006.
4. C. Zong and F. Ren, "Chinese utterance segmentation in spoken language translation," in Proc. of the 4th International Conference on Computational Linguistics and Intelligent Text Processing, 2003.
5. J. Mrozinski, E. Whittaker, P. Chatain, and S. Furui, "Automatic sentence segmentation of speech for automatic summarization," in Proc. of ICASSP, 2006.
6. J. Ang, Y. Liu, and E. Shriberg, "Automatic dialog act segmentation and classification in multiparty meetings," in Proc. of ICASSP, 2005.
7. M. Zimmermann, Y. Liu, E. Shriberg, and A. Stolcke, "Toward joint segmentation and classification of dialog acts in multiparty meetings," in Proc. of MLMI Workshop, 2005.
8. J. Makhoul, F. Kubala, and R. Schwartz, "Performance measures for information extraction," in Proc. of the DARPA Broadcast News Workshop, 1999.
9. C. Drummond and R. Holte, "Explicitly representing expected cost: An alternative to ROC representation," in Proc. of SIGKDD, 2000.
10. A. Martin, G. Doddington, T. Kamm, M. Ordowski, and M. Przybocki, "The DET curve in assessment of detection task performance," in Proc. of Eurospeech, 1997.
11. J. Davis and M. Goadrich, "The relationship between precision-recall and ROC curves," in Proc. of ICML, 2006.
12. S. Strassel, Simple Metadata Annotation Specification V6.2, Linguistic Data Consortium, 2004.