Efficient computation of confidence intervals for word error rates

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2008, Pages 5101-5104

  Vilar, Juan Miguel ^a  

^a Institute of New Imaging Technologies   (Spain)

Author keywords

Error analysis; Word error rate

Indexed keywords

ACOUSTICS; ARSENIC COMPOUNDS; COMPUTER AIDED LANGUAGE TRANSLATION; ERROR ANALYSIS; FINANCIAL DATA PROCESSING; INFORMATION THEORY; IONIZING RADIATION; LEARNING SYSTEMS; MATHEMATICAL MODELS; MICROPHONES; MONTE CARLO METHODS; SIGNAL PROCESSING; SPEECH; SPEECH TRANSMISSION;

CONFIDENCE INTERVALS; INTERNATIONAL CONFERENCES; WORD ERROR RATE;

SPEECH RECOGNITION;

EID: 51449110420     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2008.4518806     Document Type: Conference Paper

References (6)

1. M. Bisani and H. Ney, "Bootstrap estimates for confidence intervals in ASR performance evaluation," in Proceedings of the ICASSP'04, Montreal (Canada), 2004, vol. 1, pp. 409-412.
2. David Vilar, Gregor Leusch, Hermann Ney, and Rafael E. Banchs, "Human evaluation of machine translation through binary system comparisons," in Second Workshop on Statistical Machine Translation, Prague (Czech Republic), June 2007, pp. 96-103.
3. Chris Callison-Burch, Philipp Koehn, Cameron Shaw Fordyce, and Christof Monz, Eds., Proceedings of the Second Workshop on Statistical Machine Translation, ACL, Prague (Czech Republic), June 2007.
4. C. Tillmann, S. Vogel, H. Ney, H. Sawaf, and A. Zubiaga, "Accelerated DP-based search for statistical translation," in Proceedings of the EuroSpeech'97, Rhodes (Greece), Sept. 1997, ESCA, vol. 5, pp. 2667-2670.
5. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul, "A study of translation edit rate with targeted human annotation," in Proceedings of the 7th Conference of the Association for Machine Translation in the Americas, Cambrigde, Massachusets, (USA), Aug. 2006, AMTA, pp. 223-231.
6. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu, "Bleu: a method for automatic evaluation of machine translation," in Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Philadelphia, Pennsylvania (USA), 2002, pp. 311-318, ACL.