Online quality control for real-time crowd captioning

ASSETS'12 - Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility

Volumn , Issue , 2012, Pages 143-150

  Lasecki, Walter S ^a   Bigham, Jeffrey P ^a  

^a University of Rochester   (United States)

Author keywords

Captioning; Deaf; Hard of hearing; Human computation

Indexed keywords

ALTERNATIVE APPROACH; BREAK DOWN; CAPTIONING; DEAF; ERROR PRONES; GROUND TRUTH; HUMAN COMPUTATION; MECHANICAL TURKS; ON-LINE QUALITY CONTROL;

SPEECH RECOGNITION; TITANIUM COMPOUNDS;

AUDITION;

EID: 84869835491     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2384916.2384942     Document Type: Conference Paper

References (20)

1. Amazon's mechanical turk. http://www.mturk.com.
2. Y. C. Beatrice Liem, H. Zhang. An iterative dual pathway structure for speech-to-text transcription. In Proceedings of the 3rd Workshop on Human Computation (HCOMP '11), HCOMP '11, 2011.
3. M. S. Bernstein, J. R. Brandt, R. C. Miller, and D. R. Karger. Crowds in two seconds: Enabling realtime crowd-powered interfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology, UIST '11, p 33-42, 2011. ACM.
4. M. S. Bernstein, G. Little, R. C. Miller, B. Hartmann, M. S. Ackerman, D. R. Karger, D. Crowell, and K. Panovich. Soylent: a word processor with a crowd inside. In Proceedings of the 23nd annual ACM symposium on User interface software and technology, UIST '10, p 313-322, 2010. ACM.
5. J. P. Bigham, C. Jayant, H. Ji, G. Little, A. Miller, R. C. Miller, R. Miller, A. Tatarowicz, B. White, S. White, and T. Yeh. Vizwiz: nearly real-time answers to visual questions. In Proceedings of the 23nd annual ACM symposium on User interface software and technology, UIST '10, p 333-342, 2010. ACM.
6. J. P. Bigham, R. E. Ladner, and Y. Borodin. The design of human-powered access technology. In Proceedings of the 2011 SIGACCESS Conference on Computers and Accessibility (ASSETS 2011), ASSETS 2011, p 3-10, 2011. ACM.
7. L. Chilton. Seaweed: A web application for designing economic games. Master's thesis, MIT, 2009.
8. S. Cooper, F. Khatib, A. Treuille, J. Barbero, J. Lee, M. Beenen, A. Leaver-Fay, D. Baker, Z. Popovic, and F. Players. Predicting protein structures with a multiplayer online game. Nature, 466(7307):756-760, 2010.
9. X. Cui, L. Gu, B. Xiang, W. Zhang, and Y. Gao. Developing high performance asr in the ibm multilingual speech-to-speech translation system. In Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on, p 5121-5124, 2008.
10. L. B. Elliot, M. S. Stinson, D. Easton, and J. Bourgeois. College Students Learning With C-Print's Education Software and Automatic Speech Recognition. In American Educational Research Association Annual Meeting, New York, NY, 2008.
11. T. Imai, A. Matsui, S. Homma, T. Kobayakawa, K. Onoe, S. Sato, and A. Ando. Speech recognition with a re-speak method for subtitling live broadcasts. In ICSLP-2002, p 1757-1760, 2002.
12. A. Kittur, B. Smus, and R. Kraut. Crowdforge: Crowdsourcing complex work. Technical Report CMUHCII-11-100, Carnegie Mellon University, 2011.
13. W. S. Lasecki, C. D. Miller, A. Sadilek, A. AbuMoussa, and J. P. Bigham. Real-time captioning by groups of non-experts. In Proceedings of the 25rd annual ACM symposium on User interface software and technology, UIST '12. To Appear, 2012.
14. W. S. Lasecki, K. I. Murray, S. White, R. C. Miller, and J. P. Bigham. Real-time crowd control of existing interfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology, UIST '11, page 23-32, 2011. ACM.
15. G. Little, L. B. Chilton, M. Goldman, and R. C. Miller. Turkit: human computation algorithms on mechanical turk. In Proceedings of the 23rd annual ACM symposium on User interface software and technology, UIST '10, p 57-66, 2010. ACM.
16. T. Matthews, S. Carter, C. Pai, J. Fong, and J. Manko. Scribe4me: evaluating a mobile sound transcription tool for the deaf. In Proceedings of the 8th international conference on Ubiquitous Computing, UbiComp'06, p 159-176, 2006. Springer-Verlag.
17. L. von Ahn. Human Computation. PhD thesis, Carnegie Mellon University, Pittsburgh, PA, 2005.
18. L. von Ahn and L. Dabbish. Labeling images with a computer game. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '04, p 319-326, 2004. ACM.
19. M. Wald. Creating accessible educational multimedia through editing automatic speech recognition captioning in real time. Interactive Technology and Smart Education, 3(2):131-141, 2006.
20. A. A. Ye-Yi Wang and C. Chelba. Is word error rate a good indicator for spoken language understanding accuracy. In IEEE Workshop on Automatic Speech Recognition and Understanding, 2003.