Using keyword spotting to help humans correct captioning faster

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 2829-2833

  Gaur, Yashesh ^a   Metze, Florian ^a   Miao, Yajie ^a   Bigham, Jeffrey P ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Human computer interaction; Real time crowd sourcing; Speech recognition; Spoken term detection

Indexed keywords

AUDITION; HUMAN COMPUTER INTERACTION; SEARCH ENGINES; SPEECH COMMUNICATION;

AUTOMATIC SPEECH RECOGNITION; CORRECT ERROR; HARD OF HEARINGS; KEYWORD SEARCH; KEYWORD SPOTTING; NEW APPROACHES; SPOKEN TERM DETECTIONS; TECHNICAL TALKS;

SPEECH RECOGNITION;

EID: 84959147559     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, Nov 2012.
2. C. Jensema, R. McCann, and S. Ramsey, "Closed-captioned television presentation speed and vocabulary, " American Annals of the deaf, vol. 141, no. 4, pp. 284-292, 1996.
3. M. Cettolo, J. Niehues, S. Stüker, L. Bentivogli, and M. Federico, "Report on the 10th iwslt evaluation campaign, " in Proc. IWSLT, Heidelberg; Germany, 2013, http: //www. eubridge. eu/87 282. php.
4. J. Glass, T. J. Hazen, S. Cyphers, I. Malioutov, D. Huynh, and R. Barzilay, "Recent Progress in the MIT Spoken Lecture Processing Project, " in Proc. Interspeech, 2007. [Online]. Available: http: //groups. csail. mit. edu/sls/publications/2007/Interspeech07-glass-lecture. pdf
5. H. Yamazaki, K. Iwano, K. Shinoda, S. Furui, and H. Yokota, "Dynamic language model adaptation using presentation slides for lecture speech recognition, " in In Proc. INTERSPEECH, 2007, pp. 2349-2352.
6. C. Munteanu, G. Penn, and R. Baecker, "Web-based language modelling for automatic lecture transcription, " in Proc. INTERSPEECH, 2007.
7. J. Ogata, M. Goto, and K. Eto, "Automatic transcription for a web 2. 0 service to search podcasts, " in INTERSPEECH 2007, 8th Annual Conference of the International Speech Communication Association, Antwerp, Belgium, August 27-31, 2007, 2007, pp. 2617-2620.
8. G. Parent and M. Eskenazi, "Toward better crowdsourced transcription: Transcription of a year of the let's go bus information system data, " in Spoken Language Technology Workshop (SLT), 2010 IEEE. IEEE, 2010, pp. 312-317.
9. M. Marge, S. Banerjee, and A. I. Rudnicky, "Using the amazon mechanical turk for transcription of spoken language, " in Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on. IEEE, 2010, pp. 5270-5273.
10. S. Novotney and C. Callison-Burch, "Cheap, fast and good enough: Automatic speech recognition with non-expert transcription, " in Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Los Angeles, California: Association for Computational Linguistics, June 2010, pp. 207-215. [Online]. Available: http: //www. aclweb. org/anthology/N10-1024
11. C.-Y. Lee and J. R. Glass, "A transcription task for crowdsourcing with automatic quality control, " in INTERSPEECH'11, 2011, pp. 3041-3044.
12. C. Munteanu, R. Baecker, and G. Penn, "Collaborative editing for improved usefulness and usability of transcript-enhanced webcasts, " in Proceedings of the 2008 Conference on Human Factors in Computing Systems, CHI 2008, 2008, Florence, Italy, April 5-10, 2008, 2008, pp. 373-382. [Online]. Available: http: //doi. acm. org/10. 1145/1357054. 1357117
13. H. Kolkhorst, K. Kilgour, S. Stüker, and A. Waibel, "Evaluation of interactive user corrections for lecture transcription, " in 2012 International Workshop on Spoken Language Translation, IWSLT 2012, Hong Kong, December 6-7, 2012, 2012, pp. 217-221.
14. W. Lasecki, C. Miller, A. Sadilek, A. Abumoussa, D. Borrello, R. S. Kushalnagar, and J. Bigham, "Real-time captioning by groups of non-experts, " in Proceedings of the 25th annual ACM symposium on User interface software and technology-UIST '12. ACM Press, 2012, pp. 23-34.
15. M. Wald, "Crowdsourcing correction of speech recognition captioning errors, " 2011.
16. J. Trmal, G. Chen, D. Povey, S. Khudanpur, P. Ghahremani, X. Zhang, V. Manohar, C. Liu, A. Jansen, D. Klakow, D. Yarowsky, and F. Metze, "A keyword search system using open source software, " in Proc. IEEE Workshop on Spoken Language Technology. South Lake Tahoe, NV; USA: IEEE, Dec. 2014, to appear.
17. J. G. Fiscus, J. Ajot, J. S. Garofolo, and G. Doddingtion, "Results of the 2006 spoken term detection evaluation, " in Proc. SIGIR, vol. 7, 2007, pp. 51-57.
18. D. Can and M. Saraclar, "Lattice indexing for spoken term detection, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 19, no. 8, pp. 2338-2347, Nov 2011.
19. F. Seide, P. Yu, C. Ma, and E. Chang, "Vocabulary-independent search in spontaneous speech, " in Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP'04). IEEE International Conference on, vol. 1. IEEE, 2004, pp. I-253.
20. J. Mamou, B. Ramabhadran, and O. Siohan, "Vocabulary independent spoken term detection, " in Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 2007, pp. 615-622.
21. D. R. Miller, M. Kleber, C.-L. Kao, O. Kimball, T. Colthurst, S. A. Lowe, R. M. Schwartz, and H. Gish, "Rapid and accurate spoken term detection, " in Eighth Annual Conference of the International Speech Communication Association, 2007.
22. A. Rousseau, P. Deléglise, and Y. Estève, "Ted-lium: An automatic speech recognition dedicated corpus. " in LREC, 2012, pp. 125-129.
23. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely, "The kaldi speech recognition toolkit, " in IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal Processing Society, Dec. 2011.
24. Y. Miao, "Kaldi+pdnn: Building dnn-based ASR systems with kaldi and PDNN, " CoRR, vol. abs/1401. 6984, 2014. [Online]. Available: http: //arxiv. org/abs/1401. 6984
25. National Institute of Standards and Technology, "NIST open keyword search 2014 evaluation (OpenKWS14), " http: //www. nist. gov/itl/iad/mig/openkws14. cfm.
26. J. Cain, "introduction to computer science-programming paradigms, " http: //see. stanford. edu/see/lecturelist. aspx?coll=2d712634-2bf1-4b55-9a3a-ca9d470755ee.