Chorus: A crowd-powered conversational assistant

UIST 2013 - Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2013, Pages 151-162

  Lasecki, Walter S ^a   Wesley, Rachel ^a   Nichols, Jeffrey ^b   Kulkarni, Anand ^c   Allen, James F ^a   Bigham, Jeffrey P ^a,d  

^a University of Rochester   (United States)

^b IBM ALMADEN RESEARCH CENTER   (United States)

^c MobileWorks Inc   (United States)

^d Carnegie Mellon University ^*  (United States)

Author keywords

Conversational assistants; Crowd powered systems; Crowdsourcing; Dialog systems; Human computation

Indexed keywords

CONVERSATIONAL ASSISTANTS; CONVERSATIONAL INTERACTION; CONVERSATIONAL SYSTEMS; CROWDSOURCING; DIALOG SYSTEMS; HUMAN COMPUTATION; INCENTIVE MECHANISM; MACHINE INTELLIGENCE;

ARTIFICIAL INTELLIGENCE; USER INTERFACES;

HUMAN COMPUTER INTERACTION;

EID: 84887568821     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2501988.2502057     Document Type: Conference Paper

References (29)

1. Allen, J. F., Schubert, L. K., Ferguson, G., Heeman, P., Hwang, C. H., Kato, T., Light, M., Martin, N. G., Miller, B. W., Poesio, M., and Traum, D. R. Enriching speech recognition with automatic detection of sentence boundaries and disfluencies. In Journal of Experimental and Theoretical AI (JETAI) 7 (1995), 7-48.
2. Bozzon, A., Brambilla, M., and Ceri, S Answering search queries with CrowdSearcher. In WWW 2012, 33-42.
3. Bernstein, M. S., Brandt, J. R., Miller, R. C., and Karger, D. R. Crowds in two seconds: Enabling realtime crowd-powered interfaces. In UIST 2011, 33-42.
4. Bernstein, M. S., Karger, D. R., Miller, R. C., and Brandt, J. R. Analytic methods for optimizing realtime crowdsourcing. In Collective Intelligence 2012.
5. Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., and Panovich, K. Soylent: a word processor with a crowd inside. In UIST 2010, 313-322.
6. Bernstein, M. S., Teevan, J., Dumais, S., Liebling, D., and Horvitz, E. Direct answers for search queries in the long tail. In CHI 2012, 237-246.
7. Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., and Yeh, T. Vizwiz: nearly real-time answers to visual questions. In UIST 2010, 333-342.
8. Bilton, N. With apple's siri, a romance gone sour. http://bits.blogs. nytimes.com/2012/07/15/with-apple's-siri-aromance-gone-sour/.
9. Bonnington, C. Steve jobs would have 'lost his mind' over Siri, former employee says. www.wired.com/gadgetlab/2012/05/apple-siri-disappointment/.
10. Chilton, L. Seaweed: A web application for designing economic games. Master's thesis, MIT, 2009.
11. Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., Leaver-Fay, A., Baker, D., Popovic, Z., and Players, F. Predicting protein structures with a multiplayer online game. In Nature 466, 7307 (2010), 756-760.
12. Hirschman, L., Dahl, D. A., McKay, D. P., Norton, L. M., and Linebarger, M. C. Beyond class a: a proposal for automatic evaluation of discourse. In Workshop on Speech and Natural Language, HLT '90, ACL, 1990, 109-113.
13. Kittur, A., Smus, B., and Kraut, R. Crowdforge: Crowdsourcing complex work. In UIST 2011, 43-52.
14. Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M. and Horton, J. The future of crowd work. In CSCW 2013, 1301-1318.
15. Kulkarni, A. P., Can, M., and Hartmann, B. Turkomatic: automatic recursive task and workflow design for mechanical turk. In CHI 2011, 2053-2058.
16. Lasecki, W. S., Miller, C. D., Sadilek, A., AbuMoussa, A., R. Kushalnagar, and Bigham, J. Real-time captioning by groups of non-experts. In UIST 2012, 23-34.
17. Lasecki, W. S., Murray, K., White, S., Miller, R. C., and Bigham, J. P. Real-time crowd control of existing interfaces. In UIST 2011, 23-32.
18. Lasecki, W. S., Song, Y. C., Kautz, H., and Bigham, J. P. Real-time crowd labeling for deployable activity recognition. In CSCW 2013, 1203-1212.
19. Lasecki, W. S., Thiha, P., Zhong, Y., Brady, E. and Bigham, J. P. Answering Visual Questions with Conversational Crowd Assistants. In ASSETS 2013.
20. Lasecki, W. S., White, S., Murray, K. I., and Bigham, J. P. Crowd memory: Learning in the collective. In Collective Intelligence 2012.
21. Levitt, B., and March, J. G. Organizational learning. In Annual Review of Sociology 14 (1988), 319-340.
22. Little, G., Chilton, L. B., Goldman, M., and Miller, R. C. Turkit: human computation algorithms on Mechanical Turk. In UIST 2010, 57-66.
23. Sears, A., Lin, M., Jacko, J., Xiao, Y. When computers fade: Pervasive computing and situationally induced impairments and disabilities. In HCI International '03, 1298-1302.
24. Sun, Y.-A., Dance, C. R., Roy, S., and Little, G. How to assure the quality of human computation tasks when majority voting fails? In Workshop on Computational Social Science and the Wisdom of Crowds, NIPS 2011.
25. von Ahn, L. Human computation. In Ph.D. Thesis (2005).
26. von Ahn, L., and Dabbish, L. Labeling images with a computer game. In CHI 2004, 319-326.
27. Walker, M. A., Litman, D. J., Kamm, C. A., and Abella, A. Paradise: a framework for evaluating spoken dialogue agents. In Proceedings of the Association for Computational Linguistics, ACL '98, Association for Computational Linguistics (1997), 271-280.
28. Webb, N., Benyon, D., Hansen, P., and Mival, O. Evaluating human-machine conversation for appropriateness. In Proceedings of the Conference on Language Resources and Evaluation, N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, and D. Tapias, Eds., LREC'10, European Language Resources Association (ELRA) (May 2010).
29. Zhang, H., Law, E., Miller, R. C., Gajos, K. Z., Parkes, D. C., and Horvitz, E. Human computation tasks with global constraints. In CHI 2012, 217-226.