Measuring the acceptable word error rate of machine-generated webcast transcripts

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 1, Issue , 2006, Pages 157-160

  Munteanu, Cosmin ^a   Penn, Gerald ^a   Baecker, Ron ^a   Toms, Elaine ^b   James, David ^a  

^a UNIVERSITY OF TORONTO   (Canada)

^b DALHOUSIE UNIVERSITY   (Canada)

Author keywords

Prototyping; Speech recognition; User interface; Webcast; Wizard of Oz

Indexed keywords

BROADCASTING; DEEP NEURAL NETWORKS; SOFTWARE PROTOTYPING; USER INTERFACES;

AUTOMATIC SPEECH RECOGNITION SYSTEM; BROADBAND CONNECTION; HUMAN SUBJECTS; INTERNET BROADCASTING; QUESTION ANSWERING TASK; WEBCAST; WIZARD OF OZ; WORD ERROR RATE;

SPEECH RECOGNITION;

EID: 44949121547     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. P. Ritter, "The business case for on-demand rich media," Wainhouse Research Whitepapers, 2004.
2. R. M. Baecker, "A principled design for scalable internet visual communications with rich media, interactivity, and structured archives," in Proc. of CASCON, 2003, pp. 83-96.
3. B. Arons, "SpeechSkimmer: A system for interactively skimming recorded speech," ACM Transactions on Computer-Human Interaction, vol. 4, no. 1, pp. 3-38, 1997.
4. N. Sawhney and C. Schmandt, "Nomadic radio: Speech & audio interaction for contextual messaging in nomadic environments," ACM Transactions on Computer-Human Interaction, vol. 7, no. 3, pp. 353-383, 2000.
5. C. Dufour, E. G. Toms, J. Lewis, and R. M. Baecker, "User strategies for handling information tasks in webcasts," in Proc. of CHI, 2005, pp. 1343-1346.
6. S. Whittaker and J. Hirschberg, "Look or listen: Discovering effective techniques for accessing speech data," in Proc. of the Human-Computer Interaction Conference. 2003, pp. 253-269, Springer-Verlag.
7. E. Leeuwis, M. Federico, and M. Cettolo, "Language modeling and transcription of the TED Corpus lectures," in Proc. of the IEEE Conference on Acoustics, Speech, and Signal Processing, 2003, pp. 232-235.
8. I. Rogina and T. Schaaf, "Lecture and presentation tracking in an intelligent meeting room," in Proc. of the International Conference on Multimodal Interfaces, 2000.
9. K. Kato, H. Nanjo, and T. Kawahara, "Automatic transcription of lecture speech using topic-independent language modeling," in Proc. of the International Conference on Spoken Language Processing, 2000, pp. 162-165.
10. E. G. Toms, C. Dufour, J. Lewis, and R. M. Baecker, "Assessing tools for use with webcasts," in Proc. of the Joint Conference on Digital Libraries, 2005, pp. 79-88.
11. A. Park, T.J. Hazen, and J.R. Glass, "Automatic processing of audio lectures for information retrieval," in Proc. of the IEEE Conference on Acoustics, Speech, and Signal Processing, 2005, pp. 497-500.
12. R. Van Buskirk and M. J. LaLomia, "The just noticeable difference of speech recognition accuracy," in CHI Mosaic of Creativity: The Conference Companion on Human Factors in Computing Systems, 1995, p. 95.
13. M. J. LaLomia, "User acceptance of handwritten recognition accuracy," in The Conference Companion on Human Factors in Computing Systems, 1997, p. 107.
14. L. Stark, S. Whittaker, and J. Hirschberg, "ASR satisficing: The effects of ASR accuracy on speech retrieval," in Proc. of the International Conference on Spoken Language Processing, 2000, pp. 1069-1072.
15. S. Whittaker, J. Hirschberg, B. Amento, L. Stark, M. Bacchiani, P. Isenhour, L. Stead, G. Zamchick, and A. Rosenberg, "SCANMail: a voicemail interface that makes speech browsable, readable and searchable," in Proc. of the SIGCHI Conference on Human Factors in Computing Systems, 2002, pp. 275-282.
16. N.O. Bernsen, H. Dybkjaer, and L. Dybkjaer, Designing Interactive Speech Systems: From First Ideas to User Testing, Springer-Verlag, 1998.
17. A. Life, I. Salter, J.N. Temem, F. Bernard, S. Rosset, S. Bennacef, and L. Lamel, "Data collection for the MASK kiosk: WOz vs prototype system," in Proceedings of the International Conference on Speech and Language Processing, Philadelphia, Pennsylvania, USA, 1996, pp. 1672-1675.
18. C. Munteanu, R. Baecker, G. Penn, E. Toms, and D. James, "The effect of speech recognition accuracy rates on the usefulness and usability of webcast archives," in Proceedings of the ACM Conference on Human Factors in Computing Systems - CHI, 2006.
19. N. Dahlbäck, A. Jönsson, and L. Ahrenberg, "Wizard of Oz studies - why and how," in Proceedings of the International Workshop on Intelligent User Interfaces, Orlando, Florida, USA, 1993, pp. 193-200.
20. B. L. Pellom, "SONIC: The University of Colorado continuous speech recognizer," Tech. Rep. #TR-CSLR-2001-01, University of Colorado, Boulder, Colorado, 2001.
21. "The Wall Street Journal Dictation Corpus (DARPA-CSR)," The Linguistic Data Consortium, LDC94S13, 1992.
22. R. Stern, "Specifications of the 1996 Hub-4 broadcast news evaluation.," in Proc. of the DARPA Speech Recognition Workshop, 1997.
23. P.R. Clarkson and Rosenfeld R., "Statistical language modeling using the CMU-Cambridge Toolkit," in Proceedings of ESCA Eurospeech, 1997, vol. 1, pp. 2707-2710.
24. "The CMU Pronouncing Dictionary v. 0.6," http://www.speech.cs. cmu.edu/, 1998.